00000001:02000400:2.0F:1789065584.562378:0:2948:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_hostid 00000001:02000400:0.0F:1789065603.549268:0:3172:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000001:01000000:2.0:1789065605.750894:0:3210:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 647 MB/s 00000001:01000000:2.0:1789065606.002406:0:3210:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 490 MB/s 00000001:01000000:1.0F:1789065606.251745:0:3210:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3371 MB/s 00000020:02000000:0.0:1789065607.124928:0:3264:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.58_40_g706ff57 00000400:02000000:1.0:1789065607.990027:0:3279:0:(api-ni.c:2828:lnet_startup_lndni()) Added LNI 192.168.204.123@tcp [8/256/0/180] 00008000:02000000:1.0:1789065612.574650:0:3429:0:(echo_client.c:2575:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0F:1789065668.672169:0:5233:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789065680.832009:0:5819:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789065680.832017:0:5819:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789065680.832147:0:5819:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c260ee61 00000080:02000400:2.0:1789065680.832158:0:5819:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789065680.836782:0:5819:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789065680.836796:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789065680.836836:0:5819:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000006df91215) 00000020:00000080:2.0:1789065680.836856:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789065680.850872:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:1.0:1789065680.851235:0:5819:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789065680.872014:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789065680.872052:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789065680.872073:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789065680.872124:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789065680.872148:0:5819:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789065680.872469:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789065680.872476:0:5819:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789065680.872584:0:5819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c822c3 00000020:01000004:2.0:1789065680.872594:0:5819:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789065680.872673:0:5819:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789065680.872678:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c260ee61 from MGS 00000020:01000004:2.0:1789065680.872683:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789065680.872693:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e9f870a3) 00000020:00000080:2.0:1789065680.872703:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789065680.872768:0:5819:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c260ee61 from MGS, refs=2 00080000:01000000:2.0:1789065680.872774:0:5819:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789065680.872780:0:5819:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c822d1 00000100:00100000:2.0:1789065680.872933:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789065680.873064:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789065680.873070:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789065680.873918:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789065680.873928:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1789065680.875365:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789065680.875989:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1789065680.875996:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789065680.876913:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789065680.876924:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789065680.879202:0:5819:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789065680.879216:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789065680.880149:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065680.880154:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065680.880156:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065680.880605:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065680.880608:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065680.880610:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065680.881293:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1789065680.887768:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0:1789065681.133178:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3718 MB/s 00000001:01000000:2.0:1789065681.384355:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2709 MB/s 00000001:01000000:2.0:1789065681.634070:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 767 MB/s 00000001:01000000:2.0:1789065681.890784:0:5819:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 552 MB/s 00010000:00010000:1.0:1789065681.894819:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1789065681.904627:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1789065681.944174:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1789065681.944192:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789065681.944194:0:5819:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789065681.945116:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1789065681.948728:0:5819:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1789065681.948810:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1789065681.949113:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1789065681.949149:0:5819:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1789065681.951651:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065681.952047:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1789065681.952054:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1789065681.961083:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1789065681.961095:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1789065681.961431:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1789065681.961450:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1789065681.962251:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1789065681.962272:0:5819:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.123@tcp' 00000020:01000004:0.0:1789065681.962274:0:5819:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1789065681.962326:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.123@tcp (typ=mgc) 00000020:00000080:0.0:1789065681.962346:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.123@tcp (00000000cb6e5efb) 00000020:00000080:0.0:1789065681.962364:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1789065681.962493:0:5819:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004436220a@MGC192.168.204.123@tcp: add connection 192.168.204.123@tcp at head 00010000:00010000:0.0:1789065681.962699:0:5819:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.123@tcp-0 is initialized 00000040:01000000:0.0:1789065681.962706:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 1 is initialized 00000100:00080000:2.0:1789065681.963143:0:5834:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789065681.964112:0:5835:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789065681.964189:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.123@tcp (uuid 8c7529dd-e8b4-44e5-b83f-e77028f31a41) 00000020:00000080:2.0:1789065681.964209:0:5819:0:(genops.c:1384:class_connect()) connect: client 8c7529dd-e8b4-44e5-b83f-e77028f31a41, cookie 0x7555615576c822df 00000100:00080000:2.0:1789065681.964220:0:5819:0:(import.c:545:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789065681.964230:0:5819:0:(import.c:666:import_select_connection()) MGC192.168.204.123@tcp: import 000000004436220a using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065681.964268:0:5819:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000048beecab x1875971257925760/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789065681.964296:0:5819:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS 00000020:01000004:2.0:1789065681.964318:0:5819:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789065681.964325:0:5819:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789065681.964338:0:5819:0:(genops.c:413:class_newdev()) Allocate new device MDS (000000008fbc3306) 00000020:00000080:2.0:1789065681.964350:0:5819:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789065681.970623:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000048beecab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3294:1875971257925760:0@lo:250: 00000100:00100000:1.0:1789065681.970702:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065681.974237:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257925760 00000100:00100000:0.0:1789065681.974253:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257925760 00000100:00100000:0.0:1789065681.974291:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065681.974298:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d94e5c02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3294:x1875971257925760:12345-0@lo:250: 00010000:00080000:0.0:1789065681.974323:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 8c7529dd-e8b4-44e5-b83f-e77028f31a41@0@lo t0 exp 0000000000000000 cur 141 last 0 00000020:00000080:0.0:1789065681.974351:0:5831:0:(genops.c:1384:class_connect()) connect: client 8c7529dd-e8b4-44e5-b83f-e77028f31a41, cookie 0x7555615576c822ed 00000100:00080000:0.0:1789065681.977212:0:5831:0:(import.c:65:import_set_state_nolock()) 00000000d3ae7b5c : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789065681.977314:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d94e5c02 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:3294:x1875971257925760:12345-0@lo:250: Request processed in 3015us (6611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065681.977326:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789065681.983594:0:3294:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789065681.983623:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.123@tcp: connect to target with instance 0 00000100:00080000:1.0:1789065681.983633:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789065681.983639:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789065681.983642:0:3294:0:(import.c:65:import_set_state_nolock()) 000000004436220a MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789065681.983647:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789065681.983658:0:3294:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789065681.983665:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000048beecab pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3294:1875971257925760:0@lo:250: 00000100:00100000:2.0:1789065681.997544:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065682.003498:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789065682.003508:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789065682.006841:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789065682.006853:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789065682.007915:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789065682.007924:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789065682.008945:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789065682.009140:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789065682.009146:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1789065682.010397:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1789065682.010407:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789065682.076225:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065682.076425:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789065682.076674:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789065682.081778:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789065682.081799:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789065682.082793:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065682.082978:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789065682.082984:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789065682.087252:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789065682.087268:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1789065682.089311:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065682.089943:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789065682.089951:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789065682.104300:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789065682.104313:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789065682.110405:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065682.110650:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789065682.110656:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789065682.111819:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789065682.111829:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789065682.167243:0:5819:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789065682.167518:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789065682.167532:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1789065682.172137:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789065682.172157:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:2.0:1789065682.179864:0:5819:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789065682.179885:0:5819:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789065682.182915:0:5819:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789065682.182943:0:5819:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789065682.182950:0:5819:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789065682.183101:0:5819:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789065682.183136:0:5819:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789065682.183141:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789065682.183143:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789065682.183144:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789065682.183146:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789065682.183147:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789065682.183149:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789065682.183150:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789065682.183151:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789065682.183153:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789065682.183154:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789065682.183156:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789065682.183157:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789065682.183159:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789065682.183161:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789065682.183162:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789065682.183164:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789065682.183165:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789065682.183165:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789065682.183166:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789065682.183167:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789065682.183168:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789065682.183168:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789065682.183169:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789065682.183175:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789065682.183176:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789065682.183216:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789065682.183234:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257925888:0@lo:253: 00000100:00100000:3.0:1789065682.183305:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.183396:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000746da156 going to sleep for 11 seconds 00000100:00100000:1.0:1789065682.185905:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257925888 00000100:00100000:1.0:1789065682.185920:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257925888 00000100:00100000:1.0:1789065682.186003:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065682.186013:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fe2abbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:5819:x1875971257925888:12345-0@lo:253: 20000000:01000000:1.0:1789065682.186066:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1789065682.186070:0:5833:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1789065682.187942:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789065682.188118:0:5833:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:1.0:1789065682.188399:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789065682.189679:0:5855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789065682.189929:0:5833:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789065682.189933:0:5833:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789065682.189940:0:5833:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789065682.189943:0:5833:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789065682.189958:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789065682.190205:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789065682.190421:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789065682.190435:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789065682.190500:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789065682.190583:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789065682.190638:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789065682.190728:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789065682.190737:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789065682.190781:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789065682.190788:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789065682.190819:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789065682.190826:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789065682.190853:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789065682.190896:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789065682.190926:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789065682.190931:0:5833:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789065682.190944:0:5833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789065682.191143:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789065682.191154:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789065682.191189:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789065682.191226:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789065682.191275:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789065682.191287:0:5833:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789065682.191364:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789065682.191380:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789065682.191432:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789065682.191485:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789065682.191522:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789065682.191533:0:5833:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789065682.191671:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789065682.191680:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789065682.191714:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789065682.191753:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789065682.191931:0:5833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789065682.191985:0:5833:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789065682.191993:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1789065682.206837:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1789065682.213015:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1789065682.213048:0:5833:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.123@tcp for mdt 20000000:01000000:1.0:1789065682.213050:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:1.0:1789065682.213087:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1789065682.213096:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1789065682.213128:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1789065682.213135:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:1.0:1789065682.213180:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1789065682.213190:0:5833:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1789065682.213222:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1789065682.213255:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1789065682.213321:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789065682.213325:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789065682.213329:0:5833:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789065682.213341:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789065682.213350:0:5833:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789065682.213381:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789065682.213383:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789065682.218228:0:5857:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:2.0:1789065682.219802:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:2.0:1789065682.219855:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:2.0:1789065682.219927:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:2.0:1789065682.219942:0:5833:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789065682.219945:0:5833:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789065682.221894:0:5858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1789065682.222305:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1789065682.222357:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1789065682.222395:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1789065682.222413:0:5833:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789065682.222416:0:5833:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1789065682.222421:0:5833:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789065682.222423:0:5833:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789065682.222428:0:5833:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789065682.222434:0:5833:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:1.0:1789065682.225642:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:0.0:1789065682.225807:0:5833:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789065682.242811:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:0.0:1789065682.242860:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:0.0:1789065682.242957:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:0.0:1789065682.242980:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789065682.243001:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243024:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243034:0:5833:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243039:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243046:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243052:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243058:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002ac64e0e already unused, calling callback (00000000cdad3615) 00010000:00010000:0.0:1789065682.243061:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243068:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243080:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243087:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.243092:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002ac64e0e/0x7555615576c822f4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789065682.243120:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789065682.581854:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fe2abbe7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:5819:x1875971257925888:12345-0@lo:253: Request processed in 395834us (398540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065682.581872:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789065682.582014:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257925888:0@lo:253: 10000000:01000000:3.0:1789065682.582031:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789065682.582034:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789065682.582037:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789065682.582038:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789065682.582039:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789065682.582041:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789065682.582042:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789065682.582043:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789065682.582044:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789065682.582045:0:5819:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789065682.582046:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789065682.582048:0:5819:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789065682.582068:0:5819:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c260ee61 from lustre-MDT0000 10000000:01000000:3.0:1789065682.582096:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789065682.582099:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789065682.582104:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cf0581e4d40 10000000:01000000:3.0:1789065682.582108:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789065682.582115:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf0581e4d40 from 1 10000000:01000000:3.0:1789065682.582118:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789065682.582154:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.582164:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.582173:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.582210:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926016:0@lo:101: 00000100:00100000:3.0:1789065682.582246:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.582308:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbb4e8a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789065682.583825:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926016 00000100:00100000:0.0:1789065682.583838:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926016 00000100:00100000:0.0:1789065682.583903:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065682.583912:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002708704d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:5819:x1875971257926016:12345-0@lo:101: 00010000:00010000:0.0:1789065682.583927:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065682.583944:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002ac64e0e/0x7555615576c82302 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c822fb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.583970:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002ac64e0e/0x7555615576c82302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c822fb expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.583980:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002ac64e0e/0x7555615576c82302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c822fb expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.583989:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002ac64e0e, rc 0) 00000100:00100000:0.0:1789065682.584054:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002708704d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+6:5819:x1875971257926016:12345-0@lo:101: Request processed in 143us (1807us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065682.584061:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789065682.585616:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926016:0@lo:101: 00010000:00010000:3.0:1789065682.585643:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.585655:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.585738:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926144:0@lo:501: 00000100:00100000:3.0:1789065682.585788:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.585833:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbb4e8a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789065682.585964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926144 00000100:00100000:0.0:1789065682.585972:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926144 00000100:00100000:0.0:1789065682.586019:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789065682.586027:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d119b7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+6:5819:x1875971257926144:12345-0@lo:501: 00000100:00100000:0.0:1789065682.586293:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d119b7d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+6:5819:x1875971257926144:12345-0@lo:501: Request processed in 266us (505us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789065682.586311:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789065682.589988:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926144:0@lo:501: 10000000:01000000:3.0:1789065682.590042:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789065682.590065:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590076:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 000000006d7752b1/0x7555615576c822fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065682.590084:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf04c2a4800 10000000:01000000:3.0:1789065682.590092:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789065682.590096:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf04c2a4800 10000000:01000000:3.0:1789065682.590098:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789065682.590101:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cf04c2a4800 from 1 10000000:01000000:3.0:1789065682.590117:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789065682.590153:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590160:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590170:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.590189:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926272:0@lo:101: 00000100:00100000:3.0:1789065682.590247:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.590300:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbb4e8a1 going to sleep for 11 seconds 00000100:00100000:2.0:1789065682.590369:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926272 00000100:00100000:2.0:1789065682.590376:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926272 00000100:00100000:2.0:1789065682.590422:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789065682.590430:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a2118f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+6:5819:x1875971257926272:12345-0@lo:101: 00010000:00010000:2.0:1789065682.590459:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065682.590474:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000033b69dc2/0x7555615576c82310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82309 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.590497:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000033b69dc2/0x7555615576c82310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82309 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.590507:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000033b69dc2/0x7555615576c82310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82309 expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.590515:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000033b69dc2, rc 0) 00000100:00100000:2.0:1789065682.590621:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a2118f28 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+7:5819:x1875971257926272:12345-0@lo:101: Request processed in 192us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065682.590629:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789065682.590806:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926272:0@lo:101: 00010000:00010000:3.0:1789065682.590819:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590827:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065682.590841:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789065682.590844:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590850:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000a7dfadd9/0x7555615576c82309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065682.590855:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789065682.590859:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789065682.590863:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf04c2a4800 10000000:01000000:3.0:1789065682.590872:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789065682.590875:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789065682.590877:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789065682.590891:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590899:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.590905:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.590916:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926400:0@lo:101: 00000100:00100000:3.0:1789065682.590941:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.590975:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbb4e8a1 going to sleep for 11 seconds 00000100:00100000:0.0:1789065682.591037:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926400 00000100:00100000:0.0:1789065682.591043:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926400 00000100:00100000:0.0:1789065682.591079:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789065682.591086:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000f72d9932 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+7:5819:x1875971257926400:12345-0@lo:101: 00010000:00010000:0.0:1789065682.591094:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065682.591102:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005a82d058/0x7555615576c8231e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82317 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.591118:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005a82d058/0x7555615576c8231e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82317 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.591126:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005a82d058/0x7555615576c8231e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82317 expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.591131:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005a82d058, rc 0) 00000100:00100000:0.0:1789065682.591169:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000f72d9932 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+8:5819:x1875971257926400:12345-0@lo:101: Request processed in 84us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065682.591175:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789065682.591244:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926400:0@lo:101: 00010000:00010000:3.0:1789065682.591254:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.591260:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.591304:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926528:0@lo:501: 00000100:00100000:3.0:1789065682.591329:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.591351:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbb4e8a1 going to sleep for 11 seconds 00000100:00100000:2.0:1789065682.591407:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926528 00000100:00100000:2.0:1789065682.591412:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926528 00000100:00100000:1.0:1789065682.591538:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789065682.591575:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000098bf3c07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+8:5819:x1875971257926528:12345-0@lo:501: 00000100:00100000:1.0:1789065682.591863:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000098bf3c07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5819:x1875971257926528:12345-0@lo:501: Request processed in 318us (533us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065682.591871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789065682.592000:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926528:0@lo:501: 00000100:00100000:3.0:1789065682.592032:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926656:0@lo:503: 00000100:00100000:3.0:1789065682.592071:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.592105:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000cbb4e8a1 going to sleep for 11 seconds 00000100:00100000:2.0:1789065682.592258:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926656 00000100:00100000:2.0:1789065682.592263:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926656 00000100:00100000:2.0:1789065682.592295:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789065682.592302:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fce9c6f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5819:x1875971257926656:12345-0@lo:503: 00000100:00100000:2.0:1789065682.592752:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fce9c6f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5819:x1875971257926656:12345-0@lo:503: Request processed in 449us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065682.592759:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789065682.594723:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257926656:0@lo:503: 00000100:00100000:0.0:1789065682.599182:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5861:1875971257926784:0@lo:502: 00000100:00100000:0.0:1789065682.599265:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065682.599382:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 00000000fdb55035 going to sleep for 11 seconds 00000100:00100000:2.0:1789065682.601770:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926784 00000100:00100000:2.0:1789065682.601787:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926784 00000100:00100000:2.0:1789065682.601855:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789065682.601863:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000089830ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5861:x1875971257926784:12345-0@lo:502: 00000100:00100000:2.0:1789065682.602137:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000089830ebb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5861:x1875971257926784:12345-0@lo:502: Request processed in 274us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065682.602145:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789065682.602209:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5861:1875971257926784:0@lo:502: 00000020:01000000:0.0:1789065682.602246:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789065682.602256:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065682.602258:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789065682.602262:0:5861:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789065682.602265:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789065682.602284:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000009ebc7239) 00000020:00000080:0.0:1789065682.602302:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789065682.602310:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789065682.602384:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789065682.602391:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c8232c 00000020:00000080:0.0:1789065682.602850:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789065682.602854:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065682.602857:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065682.602859:0:5861:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789065682.602861:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789065682.602865:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065682.602866:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789065682.602869:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789065682.602876:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000511e9a75) 00000020:00000080:0.0:1789065682.603577:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789065682.603589:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789065682.603591:0:5861:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789065682.603593:0:5861:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789065682.603612:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789065682.603803:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c260ee61 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789065682.603820:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000004773f84c) 00000020:00000080:0.0:1789065682.603839:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789065682.604117:0:5861:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789065682.604126:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c82341 00000020:00000080:0.0:1789065682.604242:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789065682.604249:0:5861:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789065682.604254:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7555615576c82348 00080000:01000000:0.0:1789065682.604259:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789065682.604263:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c8234f 00080000:10000000:0.0:1789065682.607342:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:0.0:1789065682.609852:0:5861:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1789065682.624028:0:5861:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1789065682.683818:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1789065682.684179:0:5861:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1789065682.686468:0:5861:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1789065682.687194:0:5861:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789065682.725303:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000034f04c52) 00000020:00000080:3.0:1789065682.725327:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789065682.725441:0:5861:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789065682.725448:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c8235d 00000020:00000080:1.0:1789065682.729032:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789065682.730267:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789065682.764063:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789065682.794046:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789065682.840906:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:0.0:1789065682.875080:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1789065682.916063:0:5861:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789065682.922911:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789065682.943912:0:5861:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7555615576c82364 00000020:00000080:1.0:1789065682.944255:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789065682.944265:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065682.944269:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065682.944270:0:5861:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789065682.944272:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065682.944276:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065682.944276:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789065682.944278:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789065682.944279:0:5861:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789065682.944281:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065682.944282:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065682.944283:0:5861:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789065682.944284:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065682.944287:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065682.944288:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789065682.944290:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789065682.944316:0:5861:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:1.0:1789065682.944382:0:5861:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000000c5d0033 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5861:1875971257926912:0@lo:502: 00000100:00100000:1.0:1789065682.944465:0:5861:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065682.944521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257926912 00000100:00100000:0.0:1789065682.944529:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257926912 00000100:00100000:0.0:1789065682.944654:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789065682.944663:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000052860930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5861:x1875971257926912:12345-0@lo:502: 00000100:00100000:1.0:1789065682.944708:0:5861:0:(client.c:2716:ptlrpc_set_wait()) set 000000000576fcc3 going to sleep for 11 seconds 00000100:00100000:0.0:1789065682.945229:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000052860930 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5861:x1875971257926912:12345-0@lo:502: Request processed in 566us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065682.945237:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789065682.945310:0:5861:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000000c5d0033 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5861:1875971257926912:0@lo:502: 00000020:01000000:1.0:1789065682.945334:0:5861:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065682.945338:0:5861:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065682.945340:0:5861:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1789065682.945343:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1789065682.945489:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1789065682.945523:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1789065682.945541:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.945608:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 0000000051f27fd0/0x7555615576c82317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065682.945617:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf04c2a4800 from 1 10000000:01000000:2.0:1789065682.945620:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789065682.945661:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.945669:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.945678:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065682.945691:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006565ef43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927040:0@lo:101: 00000100:00100000:2.0:1789065682.945723:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065682.945869:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 00000000d887e981 going to sleep for 11 seconds 00000100:00100000:0.0:1789065682.946058:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927040 00000100:00100000:0.0:1789065682.946064:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927040 00000100:00100000:0.0:1789065682.946129:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789065682.946137:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c489b37d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:5819:x1875971257927040:12345-0@lo:101: 00010000:00010000:0.0:1789065682.946147:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065682.946159:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8236b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.946178:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8236b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.946187:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8236b expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.946195:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ca770f69, rc 0) 00000100:00100000:0.0:1789065682.946235:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c489b37d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:5819:x1875971257927040:12345-0@lo:101: Request processed in 99us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065682.946241:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789065682.946308:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006565ef43 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927040:0@lo:101: 00010000:00010000:3.0:1789065682.946319:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.946326:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.946878:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927168:0@lo:256: 00000100:00100000:3.0:1789065682.946926:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.947225:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080c3c4ab going to sleep for 11 seconds 00000100:00100000:2.0:1789065682.947480:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927168 00000100:00100000:2.0:1789065682.947488:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927168 00000100:00100000:2.0:1789065682.947516:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789065682.947522:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000087b47702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:5819:x1875971257927168:12345-0@lo:256: 20000000:01000000:2.0:1789065682.947539:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789065682.947545:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789065682.947665:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000087b47702 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:5819:x1875971257927168:12345-0@lo:256: Request processed in 142us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065682.947672:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789065682.947791:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927168:0@lo:256: 10000000:01000000:3.0:1789065682.948377:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789065682.948481:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.948492:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065682.948508:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf04c2a4800 from 1 10000000:01000000:3.0:1789065682.948510:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789065682.948536:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.948542:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.948578:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.948602:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927296:0@lo:101: 00000100:00100000:3.0:1789065682.948639:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.948666:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 0000000080c3c4ab going to sleep for 11 seconds 00000100:00100000:0.0:1789065682.948829:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927296 00000100:00100000:0.0:1789065682.948835:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927296 00000100:00100000:2.0:1789065682.949096:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789065682.949103:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000ae1ac4ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:5819:x1875971257927296:12345-0@lo:101: 00010000:00010000:2.0:1789065682.949113:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065682.949126:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82379 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.949145:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82379 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.949167:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82379 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065682.949175:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009bc559a0, rc 0) 00000100:00100000:2.0:1789065682.949325:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000ae1ac4ee pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257927296:12345-0@lo:101: Request processed in 222us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065682.949331:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789065682.949390:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000acbc1b94 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927296:0@lo:101: 00010000:00010000:0.0:1789065682.949404:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.949412:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065682.949466:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927424:0@lo:501: 00000100:00100000:0.0:1789065682.949494:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065682.949520:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e19acc1 going to sleep for 11 seconds 00000100:00100000:1.0:1789065682.949657:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927424 00000100:00100000:1.0:1789065682.949662:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927424 00000100:00100000:1.0:1789065682.949718:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789065682.949724:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000058cea12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257927424:12345-0@lo:501: 00000100:00100000:1.0:1789065682.950270:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000058cea12b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257927424:12345-0@lo:501: Request processed in 546us (775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065682.950277:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789065682.950346:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927424:0@lo:501: 00000100:00100000:0.0:1789065682.950376:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927552:0@lo:503: 00000100:00100000:0.0:1789065682.950411:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065682.950792:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e19acc1 going to sleep for 11 seconds 00000100:00100000:3.0:1789065682.950870:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927552 00000100:00100000:3.0:1789065682.950876:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927552 00000100:00100000:3.0:1789065682.951032:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789065682.951040:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000002cb3f7cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257927552:12345-0@lo:503: 00000040:00080000:3.0:1789065682.951076:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789065682.951121:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000002cb3f7cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257927552:12345-0@lo:503: Request processed in 83us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065682.951128:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789065682.951206:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927552:0@lo:503: 00000040:00080000:0.0:1789065682.952149:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1789065682.952309:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1789065682.952328:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789065682.952349:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952360:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065682.952407:0:5819:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789065682.952410:0:5819:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf04c2a4800 10000000:01000000:3.0:1789065682.952412:0:5819:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf04c2a4800 10000000:01000000:3.0:1789065682.952416:0:5819:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789065682.952421:0:5819:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf04c2a4800 from 1 10000000:01000000:3.0:1789065682.952424:0:5819:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789065682.952451:0:5819:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952458:0:5819:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952467:0:5819:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.952487:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003951be95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927680:0@lo:101: 00000100:00100000:3.0:1789065682.952531:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.952657:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000001815e4f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789065682.952676:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927680 00000100:00100000:3.0:1789065682.952681:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927680 00000100:00100000:3.0:1789065682.952709:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789065682.952715:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000064df0c37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257927680:12345-0@lo:101: 00010000:00010000:3.0:1789065682.952726:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065682.952741:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000091464c5e/0x7555615576c8238e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82387 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952763:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000091464c5e/0x7555615576c8238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82387 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952784:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000091464c5e/0x7555615576c8238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82387 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952793:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000091464c5e, rc 0) 00000100:00100000:3.0:1789065682.952826:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000064df0c37 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5819:x1875971257927680:12345-0@lo:101: Request processed in 112us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065682.952833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789065682.952869:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003951be95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927680:0@lo:101: 00010000:00010000:3.0:1789065682.952879:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065682.952886:0:5819:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065682.952991:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003951be95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927808:0@lo:501: 00000100:00100000:3.0:1789065682.953014:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.953026:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000001815e4f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789065682.953038:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927808 00000100:00100000:3.0:1789065682.953041:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927808 00000100:00100000:3.0:1789065682.953055:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789065682.953059:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000d8237465 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5819:x1875971257927808:12345-0@lo:501: 00000100:00100000:3.0:1789065682.953264:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000d8237465 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5819:x1875971257927808:12345-0@lo:501: Request processed in 204us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065682.953270:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789065682.953297:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003951be95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927808:0@lo:501: 00000100:00100000:3.0:1789065682.953319:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003951be95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927936:0@lo:503: 00000100:00100000:3.0:1789065682.953359:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.953371:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000001815e4f3 going to sleep for 11 seconds 00000100:00100000:3.0:1789065682.953382:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257927936 00000100:00100000:3.0:1789065682.953385:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257927936 00000100:00100000:3.0:1789065682.953401:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789065682.953405:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000c95ccf79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5819:x1875971257927936:12345-0@lo:503: 00000100:00100000:3.0:1789065682.954102:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000c95ccf79 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5819:x1875971257927936:12345-0@lo:503: Request processed in 694us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065682.954111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789065682.954230:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003951be95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257927936:0@lo:503: 00000100:00100000:2.0:1789065682.954754:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5866:1875971257928064:0@lo:502: 00000100:00100000:2.0:1789065682.954803:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065682.954868:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000039e2029f going to sleep for 11 seconds 00000100:00100000:1.0:1789065682.954970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928064 00000100:00100000:1.0:1789065682.954976:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928064 00000100:00100000:1.0:1789065682.955050:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789065682.955058:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000843af4d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5866:x1875971257928064:12345-0@lo:502: 00000100:00100000:1.0:1789065682.955274:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000843af4d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5866:x1875971257928064:12345-0@lo:502: Request processed in 218us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065682.955281:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789065682.955348:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5866:1875971257928064:0@lo:502: 00000020:01000004:2.0:1789065682.955404:0:5866:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789065682.955418:0:5866:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000aa1127b2) 00000020:00000080:2.0:1789065682.955436:0:5866:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1789065682.955509:0:5866:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c260ee61 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789065682.955513:0:5866:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c260ee61 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789065682.955515:0:5866:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c260ee61 4 00010000:00080000:2.0:1789065682.955542:0:5866:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d3b4f93f@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065682.957130:0:5866:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789065682.957339:0:5866:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789065682.957371:0:5866:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789065682.957382:0:5866:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7555615576c8239c 00000100:00080000:2.0:1789065682.957391:0:5866:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789065682.957400:0:5866:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d3b4f93f using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065682.957431:0:5866:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000e520a901 x1875971257928192/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789065682.957486:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971257928192:0@lo:38: 00000100:00100000:2.0:1789065682.957568:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789065682.957631:0:5866:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789065682.959845:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928192 00000100:00100000:3.0:1789065682.959859:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928192 00000100:00100000:3.0:1789065682.959904:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789065682.959911:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007d3c0688 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3294:x1875971257928192:12345-0@lo:38: 00000100:00100000:3.0:1789065682.960001:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007d3c0688 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3294:x1875971257928192:12345-0@lo:38: Request processed in 89us (2455us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789065682.960008:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789065682.961188:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789065682.961199:0:3294:0:(import.c:65:import_set_state_nolock()) 00000000d3b4f93f lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789065682.961205:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789065682.961208:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971257928192:0@lo:38: 00000100:00100000:3.0:1789065682.961386:0:5866:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000004b50f129 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5866:1875971257928320:0@lo:502: 00000100:00100000:3.0:1789065682.961450:0:5866:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065682.961488:0:5866:0:(client.c:2716:ptlrpc_set_wait()) set 0000000091d8b19f going to sleep for 11 seconds 00000100:00100000:3.0:1789065682.961505:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928320 00000100:00100000:3.0:1789065682.961511:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928320 00000100:00100000:3.0:1789065682.961544:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789065682.961732:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000050abeffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5866:x1875971257928320:12345-0@lo:502: 00000100:00100000:3.0:1789065682.962111:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000050abeffc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5866:x1875971257928320:12345-0@lo:502: Request processed in 381us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065682.962119:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789065682.962865:0:5866:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000004b50f129 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5866:1875971257928320:0@lo:502: 00000040:00080000:2.0:1789065682.962975:0:5866:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789065682.963129:0:5819:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789065682.963153:0:5819:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789065682.963175:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065682.963186:0:5819:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000e70c4630/0x7555615576c82387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789065682.963248:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789065682.963250:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065682.963252:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065682.963253:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065682.963254:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065682.963256:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065682.963257:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065682.963259:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065682.963260:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789065682.963262:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789065682.963263:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065682.963265:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789065682.963268:0:5819:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789065682.963271:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789065682.963272:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065682.963274:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065682.963275:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065682.963276:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065682.963277:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065682.963278:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065682.963279:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065682.963280:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789065682.963281:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789065682.963282:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065682.963283:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789065682.963302:0:5819:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789065682.963315:0:5819:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257928448:0@lo:253: 00000100:00100000:0.0:1789065682.963358:0:5819:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065682.963397:0:5819:0:(client.c:2716:ptlrpc_set_wait()) set 000000004e19acc1 going to sleep for 11 seconds 00000100:00100000:1.0:1789065682.963479:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928448 00000100:00100000:1.0:1789065682.963487:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928448 00000100:00100000:1.0:1789065682.963530:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789065682.963536:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051d22f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5819:x1875971257928448:12345-0@lo:253: 20000000:01000000:1.0:1789065682.963724:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789065682.963738:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789065683.006984:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789065683.007008:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789065683.007085:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789065683.007090:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789065683.007112:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065683.007134:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8236b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065683.007142:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065683.007179:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8236b expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065683.007193:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8236b expref: 12 pid: 5832 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065683.007206:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875971257928576:0@lo:104: 00000100:00100000:2.0:1789065683.007276:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065683.007371:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set 00000000092c9879 going to sleep for 11 seconds 00000100:00100000:1.0:1789065683.010713:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928576 00000100:00100000:1.0:1789065683.010728:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928576 00000100:00100000:1.0:1789065683.010776:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789065683.010785:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005ec21901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5854:x1875971257928576:12345-0@lo:104: 00010000:00010000:1.0:1789065683.010802:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065683.010892:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789065683.010896:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005ec21901 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5854:x1875971257928576:12345-0@lo:104: Request processed in 114us (3621us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065683.010903:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1789065683.011458:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065683.011479:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.011489:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000068b5ca2 already unused, calling callback (00000000c759678a) 10000000:00010000:3.0:1789065683.011492:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.011501:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065683.011508:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065683.011513:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065683.011580:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.011587:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065683.011618:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.011624:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: 00000000068b5ca2/0x7555615576c8236b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82372 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.011644:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065683.011646:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065683.011648:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065683.011724:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@0000000074e4b7c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257928704:0@lo:103: 00000100:00100000:1.0:1789065683.011775:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065683.012036:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875971257928576:0@lo:104: 00010000:00010000:2.0:1789065683.012059:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065683.012116:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928704 00000100:00100000:3.0:1789065683.012122:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928704 00010000:00010000:3.0:1789065683.012141:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8236b expref: 13 pid: 5832 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065683.012178:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789065683.012184:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000000c5d0033 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3296:x1875971257928704:12345-0@lo:103: 00010000:00010000:3.0:1789065683.012195:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065683.012200:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8236b expref: 13 pid: 5832 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012209:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8236b expref: 13 pid: 5832 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012222:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ca770f69/0x7555615576c82372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8236b expref: 13 pid: 5832 timeout: 292 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012233:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012239:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789065683.012253:0:5823:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005163780s 00010000:00010000:3.0:1789065683.012257:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012262:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012268:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012273:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012284:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f7536963 already unused, calling callback (00000000cdad3615) 00010000:00010000:3.0:1789065683.012287:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012293:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012316:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065683.012325:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065683.012364:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000000c5d0033 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3296:x1875971257928704:12345-0@lo:103: Request processed in 181us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065683.012371:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789065683.012585:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065683.012603:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065683.012608:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f7536963/0x7555615576c823a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065683.012752:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@0000000074e4b7c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257928704:0@lo:103: 00000100:00100000:2.0:1789065683.025759:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051d22f93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5819:x1875971257928448:12345-0@lo:253: Request processed in 62215us (62392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065683.025775:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789065683.025944:0:5819:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5819:1875971257928448:0@lo:253: 10000000:01000000:0.0:1789065683.025960:0:5819:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789065683.025963:0:5819:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789065683.025965:0:5819:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065683.025967:0:5819:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065683.025968:0:5819:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065683.025982:0:5819:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065683.025983:0:5819:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065683.025985:0:5819:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065683.025986:0:5819:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065683.025987:0:5819:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789065683.025989:0:5819:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789065683.025990:0:5819:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065683.025992:0:5819:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789065683.026007:0:5819:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789065683.034659:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065683.035223:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789065683.035529:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065683.035771:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789065683.037302:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065683.037774:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789065683.038772:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065683.039048:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789065683.039259:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065683.039501:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789065683.040025:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065683.040220:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:1.0:1789065683.064870:0:5819:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1789065683.108776:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1789065683.108853:0:5871:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:2.0:1789065683.108858:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1789065683.109112:0:5872:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:1.0:1789065683.113352:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1789065683.113529:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1789065683.114220:0:5819:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1789065683.114304:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1789065683.114634:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789065683.115922:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1789065683.116443:0:5819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1789065683.116473:0:5819:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:1.0:1789065683.116834:0:5819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:1.0:1789065683.117055:0:5819:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1789065683.118312:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1789065683.118623:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1789065683.118829:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1789065683.118987:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1789065683.119123:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1789065683.119285:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1789065683.119430:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1789065683.119726:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1789065683.119861:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1789065683.120014:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1789065683.120160:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1789065683.120302:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1789065683.120440:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1789065683.120712:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1789065683.120865:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1789065683.121009:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1789065683.121290:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1789065683.122247:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1789065683.122395:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1789065683.124261:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789065683.124441:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789065683.124707:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789065683.124859:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789065683.125010:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789065683.125503:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789065683.125770:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789065683.125917:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789065683.126105:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789065683.126245:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789065683.126387:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789065683.126529:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789065683.126803:0:5819:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789065683.126980:0:5819:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789065683.146925:0:5872:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789065683.189476:0:5819:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789065683.189514:0:5819:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa0481ca7988 00100000:10000000:2.0:1789065683.189522:0:5819:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789065683.194339:0:5819:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789065683.194364:0:5819:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789065683.194394:0:5819:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789065683.194429:0:5819:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789065683.230843:0:5872:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789065683.230919:0:5872:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789065683.230923:0:5872:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789065683.941686:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065684.965904:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065685.991850:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065687.013840:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065688.042619:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789065688.229728:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789065688.229738:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789065688.229749:0:37:0:(import.c:65:import_set_state_nolock()) 00000000d3b4f93f lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789065688.229770:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d3b4f93f using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789065688.229797:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003f881cf3 x1875971257928960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789065688.229889:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065688.229904:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000fe144cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257928832:0@lo:400: 00000100:00100000:3.0:1789065688.230107:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065688.230169:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971257928960:0@lo:38: 00000100:00100000:3.0:1789065688.230203:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065688.230246:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928832 00000100:00100000:3.0:1789065688.230255:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928832 00000100:00100000:3.0:1789065688.230299:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789065688.230310:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009639ecb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:3298:x1875971257928832:12345-0@lo:400: 00000100:00100000:3.0:1789065688.230362:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009639ecb3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:3298:x1875971257928832:12345-0@lo:400: Request processed in 55us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065688.230371:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789065688.230436:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000fe144cc1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257928832:0@lo:400: 00000100:00100000:2.0:1789065688.231045:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257928960 00000100:00100000:2.0:1789065688.231052:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257928960 00000100:00100000:2.0:1789065688.231084:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789065688.231090:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000b54a5a8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3294:x1875971257928960:12345-0@lo:38: 00010000:00080000:2.0:1789065688.231116:0:5840:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 147 last 0 00000020:00000080:2.0:1789065688.231165:0:5840:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7555615576c823aa 00000004:00100000:2.0:1789065688.231209:0:5840:0:(mdt_handler.c:7356:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789065688.232276:0:5840:0:(import.c:65:import_set_state_nolock()) 000000000656a532 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789065688.232354:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000b54a5a8d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875971257928960:12345-0@lo:38: Request processed in 1262us (2149us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065688.232364:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789065688.232601:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003f881cf3 x1875971257928960/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789065698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789065688.232621:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789065688.232630:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789065688.232634:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789065688.232637:0:3294:0:(import.c:65:import_set_state_nolock()) 00000000d3b4f93f lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789065688.232642:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971257928960:0@lo:38: 00000001:02000400:1.0:1789065688.351753:0:6116:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789065689.061980:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065690.086790:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789065690.792908:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789065690.792916:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf04c2a4800 from 3 10000000:01000000:0.0:1789065690.792922:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789065690.792999:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065690.793035:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065690.793098:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065690.793133:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929088:0@lo:101: 00000100:00100000:0.0:1789065690.793303:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065690.793478:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132a6be4 going to sleep for 11 seconds 00000100:00100000:2.0:1789065690.793634:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929088 00000100:00100000:2.0:1789065690.793658:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929088 00000100:00100000:2.0:1789065690.793755:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789065690.793764:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000009cbaae42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5835:x1875971257929088:12345-0@lo:101: 00010000:00010000:2.0:1789065690.793817:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065690.793831:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000017d883b7/0x7555615576c823b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c823b1 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065690.793901:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000017d883b7/0x7555615576c823b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c823b1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065690.793927:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000017d883b7/0x7555615576c823b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c823b1 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065690.793935:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000017d883b7, rc 0) 00000100:00100000:2.0:1789065690.794057:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000009cbaae42 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257929088:12345-0@lo:101: Request processed in 294us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065690.794091:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065690.794807:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929088:0@lo:101: 00010000:00010000:0.0:1789065690.794833:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065690.794865:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065690.794944:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929216:0@lo:256: 00000100:00100000:0.0:1789065690.795002:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065690.795051:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 00000000132a6be4 going to sleep for 11 seconds 00000100:00100000:3.0:1789065690.795147:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929216 00000100:00100000:3.0:1789065690.795161:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929216 00000100:00100000:3.0:1789065690.795214:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789065690.795220:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000051fe0414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257929216:12345-0@lo:256: 20000000:01000000:3.0:1789065690.795234:0:5832:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789065690.795247:0:5832:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789065690.795251:0:5832:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1789065690.795332:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000051fe0414 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257929216:12345-0@lo:256: Request processed in 113us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065690.795339:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789065690.795585:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929216:0@lo:256: 10000000:01000000:0.0:1789065690.795621:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789065690.795626:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065690.795634:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: 00000000fcabe0f8/0x7555615576c823b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065691.111965:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065692.133723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065693.157821:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065693.349968:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065693.349994:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257929344:0@lo:400: 00000100:00100000:2.0:1789065693.350064:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065693.350121:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000591ecd4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257929472:0@lo:400: 00000100:00100000:2.0:1789065693.350147:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065693.350184:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929344 00000100:00100000:2.0:1789065693.350205:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929344 00000100:00100000:2.0:1789065693.350263:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789065693.350271:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000091df57f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3297:x1875971257929344:12345-0@lo:400: 00000100:00100000:2.0:1789065693.350320:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000091df57f8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3297:x1875971257929344:12345-0@lo:400: Request processed in 50us (256us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065693.350327:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789065693.350495:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929472 00000100:00100000:2.0:1789065693.350500:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929472 00000100:00100000:2.0:1789065693.350530:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789065693.350536:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000085c4fd55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257929472:12345-0@lo:400: 00000100:00100000:2.0:1789065693.353097:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000085c4fd55 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257929472:12345-0@lo:400: Request processed in 2554us (2941us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065693.353113:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789065693.353204:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257929344:0@lo:400: 00010000:00080000:3.0:1789065693.354740:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000591ecd4c x1875971257929472/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065693.354759:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000591ecd4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257929472:0@lo:400: 00000020:00000080:2.0:1789065693.858681:0:6318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcaf0faee0 20000000:00000080:2.0:1789065693.858698:0:6318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf052fbb400 uarg=0000000000000000 20000000:01000000:2.0:1789065693.858996:0:6318:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789065693.859003:0:6318:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789065693.859007:0:6318:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1789065693.861048:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:2.0:1789065693.861065:0:6318:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1789065693.868758:0:6318:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789065693.869013:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1789065693.869067:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1789065693.869113:0:6318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1789065693.869132:0:6318:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789065693.869149:0:6318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065693.869166:0:6318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82379 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065693.869174:0:6318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065693.869219:0:6318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82379 expref: 11 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065693.869233:0:6318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82379 expref: 11 pid: 5832 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065693.869246:0:6318:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875971257929600:0@lo:104: 00000100:00100000:2.0:1789065693.869308:0:6318:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065693.869362:0:6318:0:(client.c:2716:ptlrpc_set_wait()) set 000000003b384df0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065693.869459:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929600 00000100:00100000:1.0:1789065693.869467:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929600 00000100:00100000:1.0:1789065693.870375:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065693.870401:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000007f3fee4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:6318:x1875971257929600:12345-0@lo:104: 00010000:00010000:1.0:1789065693.870417:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065693.870487:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789065693.870492:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000007f3fee4e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:6318:x1875971257929600:12345-0@lo:104: Request processed in 109us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065693.870509:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789065693.870721:0:6318:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000e520a901 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6318:1875971257929600:0@lo:104: 00010000:00010000:2.0:1789065693.870743:0:6318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.870811:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065693.870817:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.870825:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ea75f494 already unused, calling callback (00000000c759678a) 10000000:00010000:0.0:1789065693.870828:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.870836:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065693.870860:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065693.870866:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065693.870903:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.870910:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065693.870937:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.870944:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: 00000000ea75f494/0x7555615576c82379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82380 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.870961:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065693.870963:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065693.870965:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065693.870966:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257929728:0@lo:103: 00000100:00100000:1.0:1789065693.871018:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065693.871799:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929728 00000100:00100000:0.0:1789065693.871807:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929728 00010000:00010000:0.0:1789065693.871833:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82379 expref: 12 pid: 5832 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065693.871868:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789065693.871875:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000a788708f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3296:x1875971257929728:12345-0@lo:103: 00010000:00010000:0.0:1789065693.871886:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065693.871890:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82379 expref: 12 pid: 5832 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871900:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82379 expref: 12 pid: 5832 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871922:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000009bc559a0/0x7555615576c82380 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82379 expref: 12 pid: 5832 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871937:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871944:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871957:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871963:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871968:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871973:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871978:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000068b5ca2 already unused, calling callback (00000000cdad3615) 00010000:00010000:0.0:1789065693.871981:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871987:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.871997:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065693.872014:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065693.872055:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000a788708f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:3296:x1875971257929728:12345-0@lo:103: Request processed in 182us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065693.872062:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789065693.872418:0:6318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065693.872420:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000006b85e1ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257929728:0@lo:103: 00010000:00010000:2.0:1789065693.872443:0:6318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065693.872449:0:6318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000068b5ca2/0x7555615576c823bf lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065694.183188:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065695.208428:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065696.229862:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065697.253702:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789065697.258465:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789065697.258474:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf04c2a4800 from 1 10000000:01000000:3.0:1789065697.258478:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789065697.258530:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: 00000000aca4e5cc/0x7555615576c823c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065697.258544:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: 00000000aca4e5cc/0x7555615576c823c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065697.258578:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: 00000000aca4e5cc/0x7555615576c823c6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065697.258602:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929856:0@lo:101: 00000100:00100000:3.0:1789065697.258671:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065697.259836:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929856 00000100:00100000:2.0:1789065697.259848:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929856 00000100:00100000:2.0:1789065697.259899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789065697.259908:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@0000000037a8ad26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:5835:x1875971257929856:12345-0@lo:101: 00010000:00010000:2.0:1789065697.259924:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065697.259939:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7536963/0x7555615576c823cd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c823c6 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065697.259975:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7536963/0x7555615576c823cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c823c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065697.259985:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7536963/0x7555615576c823cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c823c6 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065697.259993:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7536963, rc 0) 00000100:00100000:2.0:1789065697.260039:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@0000000037a8ad26 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257929856:12345-0@lo:101: Request processed in 132us (1369us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065697.260045:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789065697.260187:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cfb69c8 going to sleep for 11 seconds 00000100:00100000:3.0:1789065697.260211:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929856:0@lo:101: 00010000:00010000:3.0:1789065697.260239:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: 00000000aca4e5cc/0x7555615576c823c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065697.260248:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: 00000000aca4e5cc/0x7555615576c823c6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065697.260489:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929984:0@lo:501: 00000100:00100000:3.0:1789065697.260521:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065697.260564:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cfb69c8 going to sleep for 11 seconds 00000100:00100000:2.0:1789065697.260814:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257929984 00000100:00100000:2.0:1789065697.260820:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257929984 00000100:00100000:2.0:1789065697.260886:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789065697.260893:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@00000000fba09329 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257929984:12345-0@lo:501: 00000100:00100000:2.0:1789065697.261112:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@00000000fba09329 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257929984:12345-0@lo:501: Request processed in 220us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065697.261120:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789065697.261182:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257929984:0@lo:501: 00000100:00100000:3.0:1789065697.261213:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257930112:0@lo:503: 00000100:00100000:3.0:1789065697.261253:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065697.269474:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cfb69c8 going to sleep for 11 seconds 00000100:00100000:1.0:1789065697.272377:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930112 00000100:00100000:1.0:1789065697.272391:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930112 00000100:00100000:1.0:1789065697.272438:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789065697.272445:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000005f529e36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257930112:12345-0@lo:503: 00000100:00100000:1.0:1789065697.272674:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000005f529e36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257930112:12345-0@lo:503: Request processed in 228us (11421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065697.272682:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789065697.272773:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@000000003f881cf3 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257930112:0@lo:503: 00000100:00100000:1.0:1789065697.274421:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@00000000a12efaca pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6530:1875971257930240:0@lo:502: 00000100:00100000:1.0:1789065697.274488:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065697.274521:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930240 00000100:00100000:1.0:1789065697.274527:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930240 00000100:00100000:1.0:1789065697.274581:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789065697.274588:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@000000008c4a3188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6530:x1875971257930240:12345-0@lo:502: 00000100:00100000:1.0:1789065697.275383:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@000000008c4a3188 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6530:x1875971257930240:12345-0@lo:502: Request processed in 795us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065697.275392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789065697.275450:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set 000000005cfb69c8 going to sleep for 11 seconds 00000100:00100000:1.0:1789065697.275470:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@00000000a12efaca pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6530:1875971257930240:0@lo:502: 00000020:01000000:1.0:1789065697.275500:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065697.275509:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065697.275512:0:6530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789065697.275519:0:6530:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf04c2a4800 00000020:00000080:1.0:1789065697.275522:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789065697.275589:0:6530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6530:1875971257930368:0@lo:502: 00000100:00100000:1.0:1789065697.275626:0:6530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065697.275651:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930368 00000100:00100000:1.0:1789065697.275656:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930368 00000100:00100000:1.0:1789065697.276381:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789065697.276392:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6530:x1875971257930368:12345-0@lo:502: 00000100:00100000:1.0:1789065697.276582:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6530:x1875971257930368:12345-0@lo:502: Request processed in 191us (955us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065697.276591:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789065697.276640:0:6530:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065697.276656:0:6530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6530:1875971257930368:0@lo:502: 00000020:01000000:1.0:1789065697.276681:0:6530:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065697.276685:0:6530:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065697.276687:0:6530:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1789065697.276691:0:6530:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:1.0:1789065697.277038:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1789065697.277057:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789065697.277067:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065697.277079:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065698.282880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065698.476874:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257930624:0@lo:400: 00000100:00100000:1.0:1789065698.476979:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065698.477061:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789065698.477069:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257930496:0@lo:400: 00000100:00100000:1.0:1789065698.477101:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065698.478155:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930624 00000100:00100000:1.0:1789065698.478169:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930624 00000100:00100000:1.0:1789065698.478235:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065698.478245:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257930624:12345-0@lo:400: 00000100:00100000:1.0:1789065698.478541:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257930624:12345-0@lo:400: Request processed in 295us (1561us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065698.478575:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789065698.479183:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf07ae64000 x1875971257930624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065698.479202:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257930624:0@lo:400: 00000100:00100000:0.0:1789065698.483481:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930496 00000100:00100000:0.0:1789065698.483500:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930496 00000100:00100000:0.0:1789065698.483770:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065698.483783:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3298:x1875971257930496:12345-0@lo:400: 00000100:00100000:0.0:1789065698.483899:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3298:x1875971257930496:12345-0@lo:400: Request processed in 119us (6796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065698.483907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065698.483958:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257930496:0@lo:400: 00010000:00010000:3.0:1789065699.301670:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065700.326222:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065701.350089:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789065701.469381:0:6683:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789065701.469386:0:6683:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789065701.469813:0:6683:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf07a795800 00000020:01000004:2.0:1789065701.469835:0:6683:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1789065701.469849:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789065701.469880:0:6683:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cf06a5119c0) 00000020:00000080:2.0:1789065701.469904:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789065701.514839:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789065701.515161:0:6683:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789065701.551033:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789065701.572068:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789065701.572108:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789065701.572176:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789065701.572289:0:6683:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789065701.572961:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789065701.572976:0:6683:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789065701.572989:0:6683:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7555615576c823db 00000020:01000004:2.0:1789065701.573000:0:6683:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789065701.573026:0:6683:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789065701.573031:0:6683:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789065701.573038:0:6683:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789065701.573043:0:6683:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789065701.573058:0:6683:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cf06a510000) 00000020:00000080:2.0:1789065701.573070:0:6683:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1789065701.576132:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065701.576428:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789065701.576435:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1789065701.593101:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1789065701.593131:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1789065701.598084:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1789065701.598101:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1789065701.600963:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065701.603891:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1789065701.603913:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789065701.609123:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789065701.609141:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1789065701.650050:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065701.650746:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789065701.650756:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1789065701.652471:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789065701.652488:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789065701.654305:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789065701.654322:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789065701.658195:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789065701.658994:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789065701.659004:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789065701.660280:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789065701.660297:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789065701.766080:0:6683:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789065701.767014:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1789065701.767027:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1789065701.770138:0:6683:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789065701.770161:0:6683:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789065701.771322:0:6683:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789065701.771359:0:6683:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789065701.771368:0:6683:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789065701.826993:0:6683:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789065701.827046:0:6683:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1789065701.827054:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789065701.827056:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789065701.827058:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789065701.827059:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789065701.827060:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789065701.827061:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789065701.827063:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789065701.827064:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789065701.827066:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789065701.827068:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789065701.827070:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789065701.827074:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1789065701.827077:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789065701.827078:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789065701.827079:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789065701.827080:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789065701.827081:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789065701.827081:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789065701.827082:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789065701.827083:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789065701.827084:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789065701.827085:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789065701.827086:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789065701.827123:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789065701.827150:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257930752:0@lo:253: 00000100:00100000:3.0:1789065701.827402:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065701.827819:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065701.828006:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930752 00000100:00100000:2.0:1789065701.828017:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930752 00000100:00100000:2.0:1789065701.828128:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789065701.828141:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257930752:12345-0@lo:253: 20000000:01000000:2.0:1789065701.828185:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789065701.828190:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1789065701.828209:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1789065701.828213:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1789065701.830145:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789065701.830445:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1789065701.830462:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1789065701.830919:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1789065701.830930:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1789065701.830960:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1789065701.831033:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1789065701.834972:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1789065701.835025:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:2.0:1789065701.835029:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789065701.835095:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1789065701.835103:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789065701.835162:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1789065701.835170:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:2.0:1789065701.835287:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1789065701.835299:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1789065701.835336:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1789065701.835388:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1789065701.844416:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1789065701.844459:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:3.0:1789065701.844462:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:3.0:1789065701.844513:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1789065701.844522:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1789065701.844596:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1789065701.844605:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:3.0:1789065701.844674:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1789065701.844687:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1789065701.844731:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1789065701.844767:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1789065701.844786:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1789065701.844790:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1789065701.844794:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1789065701.844811:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789065701.844814:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789065701.844855:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789065701.844858:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789065701.849192:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:0.0:1789065701.850146:0:6698:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:0.0:1789065701.852805:0:6698:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1789065701.854543:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1789065701.854654:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1789065701.854748:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1789065701.854765:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1789065701.854768:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789065701.855974:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:3.0:1789065701.856072:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:3.0:1789065701.856123:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789065701.857120:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789065701.857176:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789065701.857228:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789065701.857258:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789065701.857261:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789065701.858268:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:0.0:1789065701.858633:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:0.0:1789065701.858681:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:0.0:1789065701.858756:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:0.0:1789065701.858777:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:0.0:1789065701.858780:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:0.0:1789065701.858792:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789065701.858817:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.858981:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c822fb expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.858991:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82317 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.858998:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82387 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.859006:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.859057:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82387 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.859077:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82387 expref: 12 pid: 5831 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.859096:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257930880:0@lo:104: 00000100:00100000:0.0:1789065701.859201:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789065701.859285:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82317 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.859294:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82317 expref: 12 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.859303:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257931008:0@lo:104: 00000100:00100000:0.0:1789065701.859326:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065701.859363:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257930880 00000100:00100000:0.0:1789065701.859372:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257930880 00000100:00100000:0.0:1789065701.859415:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931008 00000100:00100000:0.0:1789065701.859419:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931008 00000100:00100000:0.0:1789065701.859435:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065701.859445:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:5831:x1875971257930880:12345-0@lo:104: 00010000:00010000:0.0:1789065701.859460:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.860032:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065701.860041:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:5831:x1875971257930880:12345-0@lo:104: Request processed in 597us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065701.860050:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065701.860079:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789065701.860087:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257931008:12345-0@lo:104: 00010000:00010000:0.0:1789065701.860096:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.860133:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789065701.860138:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257931008:12345-0@lo:104: Request processed in 53us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065701.860155:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789065701.860176:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789065701.860183:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.860192:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff800 already unused, calling callback (ffffffffc1b4dc20) 00010000:00010000:3.0:1789065701.860393:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 10000000:00010000:0.0:1789065701.860955:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.860969:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065701.860977:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065701.860983:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789065701.861038:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.861046:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065701.861069:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.861077:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8238e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.861095:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065701.861097:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065701.861100:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065701.861116:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257931136:0@lo:103: 00000100:00100000:0.0:1789065701.861180:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065701.861625:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931136 00000100:00100000:0.0:1789065701.861634:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931136 00010000:00010000:0.0:1789065701.861668:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82387 expref: 13 pid: 5831 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.861702:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065701.861710:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3295:x1875971257931136:12345-0@lo:103: 00010000:00010000:0.0:1789065701.861750:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065701.861758:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82387 expref: 13 pid: 5831 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.861771:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82387 expref: 13 pid: 5831 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.861795:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065701.861994:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.862009:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.862017:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff400 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065701.862020:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.862029:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065701.862035:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065701.862041:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789065701.862064:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.862070:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065701.862081:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.862086:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8231e expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.862099:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.862101:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.862103:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.862113:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.862114:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065701.862659:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3295:x1875971257931136:12345-0@lo:103: Request processed in 126us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065701.862671:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065701.862712:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257931264:0@lo:103: 00000100:00100000:0.0:1789065701.862915:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065701.863039:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257931136:0@lo:103: 00010000:00010000:0.0:1789065701.863095:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c822fb expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.863111:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c822fb expref: 12 pid: 5832 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.863123:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257931392:0@lo:104: 00000100:00100000:0.0:1789065701.863161:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065701.863191:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca0780 going to sleep for 11 seconds 00010000:00010000:0.0:1789065701.863217:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821fe800/0x7555615576c8238e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82387 expref: 12 pid: 5831 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.863241:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257930880:0@lo:104: 00000100:00100000:0.0:1789065701.863252:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257931008:0@lo:104: 00000100:00100000:3.0:1789065701.863648:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931392 00000100:00100000:3.0:1789065701.863658:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931392 00000100:00100000:3.0:1789065701.863706:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789065701.863716:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257931392:12345-0@lo:104: 00010000:00010000:3.0:1789065701.863733:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.863808:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789065701.863814:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257931392:12345-0@lo:104: Request processed in 100us (652us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065701.863820:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789065701.864001:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065701.864008:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.864016:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065701.864020:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.864029:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065701.864037:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065701.864042:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789065701.864087:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.864093:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065701.864120:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.864128:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c822fb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82302 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.864161:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065701.864163:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065701.864164:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065701.864174:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789065701.864188:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257931520:0@lo:103: 00000100:00100000:0.0:1789065701.864245:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065701.864716:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257931392:0@lo:104: 00010000:00010000:1.0:1789065701.864766:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065701.865117:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931264 00000100:00100000:2.0:1789065701.865126:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931264 00010000:00010000:2.0:1789065701.865170:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82317 expref: 12 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065701.865217:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931520 00000100:00100000:2.0:1789065701.865222:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931520 00010000:00010000:2.0:1789065701.865245:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c822fb expref: 13 pid: 5832 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065701.865259:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065701.865268:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3296:x1875971257931264:12345-0@lo:103: 00010000:00010000:2.0:1789065701.865282:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065701.865289:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82317 expref: 13 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865301:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82317 expref: 13 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865320:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030e00/0x7555615576c8231e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82317 expref: 13 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865336:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065701.865409:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3296:x1875971257931264:12345-0@lo:103: Request processed in 134us (2486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065701.865416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065701.865435:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789065701.865440:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:3298:x1875971257931520:12345-0@lo:103: 00010000:00010000:2.0:1789065701.865447:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065701.865451:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c822fb expref: 11 pid: 5832 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865468:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c822fb expref: 11 pid: 5832 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865478:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040031200/0x7555615576c82302 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c822fb expref: 11 pid: 5832 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865501:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865510:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865527:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865535:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865541:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865572:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865578:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065701.865583:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865591:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865615:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.865624:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065701.865649:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:3298:x1875971257931520:12345-0@lo:103: Request processed in 210us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065701.865656:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789065701.866431:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257931264:0@lo:103: 00010000:00010000:1.0:1789065701.866487:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.866499:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.866506:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030400/0x7555615576c823e9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789065701.866535:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1789065701.876624:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257931520:0@lo:103: 00000100:00100000:2.0:1789065701.958973:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:6683:x1875971257930752:12345-0@lo:253: Request processed in 130818us (131555us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065701.958995:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789065701.962301:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257930752:0@lo:253: 10000000:01000000:3.0:1789065701.962368:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1789065701.962372:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789065701.962374:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789065701.962376:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789065701.962378:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1789065701.962380:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789065701.962381:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789065701.962394:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789065701.962396:0:6683:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789065701.962630:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789065701.962632:0:6683:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789065701.962664:0:6683:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf07a795800 from lustre-OST0000 10000000:01000000:3.0:1789065701.962705:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1789065701.962709:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789065701.962719:0:6683:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf0581e4d40 local copy 10000000:01000000:3.0:1789065701.962725:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789065701.962785:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.962799:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.962810:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065701.962834:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257931648:0@lo:101: 00000100:00100000:3.0:1789065701.962930:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065701.963009:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5acc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065701.966702:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931648 00000100:00100000:1.0:1789065701.966725:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931648 00000100:00100000:1.0:1789065701.966820:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789065701.966833:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:6683:x1875971257931648:12345-0@lo:101: 00010000:00010000:1.0:1789065701.966882:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065701.966911:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072200/0x7555615576c823f7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c823f0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.966948:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072200/0x7555615576c823f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c823f0 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.966962:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072200/0x7555615576c823f7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c823f0 expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.966971:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072200, rc 0) 00000100:00100000:1.0:1789065701.967081:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:6683:x1875971257931648:12345-0@lo:101: Request processed in 251us (4151us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065701.967089:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789065701.968445:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257931648:0@lo:101: 00010000:00010000:0.0:1789065701.968477:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.968491:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.968726:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257931776:0@lo:501: 00000100:00100000:0.0:1789065701.968801:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065701.968842:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca06c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065701.969045:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931776 00000100:00100000:2.0:1789065701.969052:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931776 00000100:00100000:2.0:1789065701.969091:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789065701.969100:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:6683:x1875971257931776:12345-0@lo:501: 00000100:00100000:2.0:1789065701.970272:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:6683:x1875971257931776:12345-0@lo:501: Request processed in 1165us (1462us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789065701.970285:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789065701.970463:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257931776:0@lo:501: 10000000:01000000:0.0:1789065701.970492:0:6683:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789065701.970582:0:6683:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789065701.970593:0:6683:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.970607:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.970617:0:6683:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.970653:0:6683:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789065701.970687:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf07a795800 10000000:01000000:0.0:1789065701.970694:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789065701.970700:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cf0581e4d40 10000000:01000000:0.0:1789065701.970702:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789065701.970707:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cf0581e4d40 from 1 10000000:01000000:0.0:1789065701.970711:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789065701.970752:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.970761:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065701.970773:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065701.970796:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257931904:0@lo:101: 00000100:00100000:0.0:1789065701.970856:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065701.970889:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca0180 going to sleep for 11 seconds 00000100:00100000:1.0:1789065701.970970:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257931904 00000100:00100000:1.0:1789065701.970979:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257931904 00000100:00100000:1.0:1789065701.971032:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789065701.971042:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+10:6683:x1875971257931904:12345-0@lo:101: 00010000:00010000:1.0:1789065701.971055:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065701.971072:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072000/0x7555615576c82405 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c823fe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.971115:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072000/0x7555615576c82405 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c823fe expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.971130:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072000/0x7555615576c82405 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c823fe expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065701.971140:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072000, rc 0) 00010000:00010000:2.0:1789065701.971175:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065701.971183:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.971203:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065701.971207:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.971217:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065701.971243:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065701.971249:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789065701.971272:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.971278:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065701.971310:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.971317:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffc00/0x7555615576c823f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x7555615576c823f7 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.971335:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.971337:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065701.971339:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065701.971384:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065701.971409:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257932032:0@lo:103: 00000100:00100000:3.0:1789065701.971452:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065701.971617:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257931904:12345-0@lo:101: Request processed in 576us (761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065701.971625:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789065701.971690:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257931904:0@lo:101: 00010000:00010000:3.0:1789065701.971713:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.971723:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065701.971745:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789065701.971762:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.971771:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065701.971779:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789065701.971784:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789065701.971789:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789065701.971791:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789065701.971808:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.971815:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.971824:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065701.971837:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932160:0@lo:101: 00000100:00100000:3.0:1789065701.971871:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065701.971895:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065701.971912:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932160 00000100:00100000:3.0:1789065701.971924:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932160 00000100:00100000:3.0:1789065701.971959:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789065701.971966:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932160:12345-0@lo:101: 00010000:00010000:3.0:1789065701.971975:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065701.971986:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8240c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.972003:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8240c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.972011:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8240c expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.972018:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fea00, rc 0) 00000100:00100000:3.0:1789065701.972044:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257932160:12345-0@lo:101: Request processed in 79us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065701.972050:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789065701.972084:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932160:0@lo:101: 00010000:00010000:3.0:1789065701.972093:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065701.972100:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065701.972205:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932288:0@lo:501: 00000100:00100000:3.0:1789065701.972241:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065701.972252:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5ae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065701.972447:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932032 00000100:00100000:2.0:1789065701.972452:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932032 00000100:00100000:2.0:1789065701.972496:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789065701.972504:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3297:x1875971257932032:12345-0@lo:103: 00010000:00010000:2.0:1789065701.972516:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065701.972534:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072200/0x7555615576c823f7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c823f0 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065701.972576:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065701.972593:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932288 00000100:00100000:1.0:1789065701.972613:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932288 00000100:00100000:2.0:1789065701.972619:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:3297:x1875971257932032:12345-0@lo:103: Request processed in 114us (1165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065701.972627:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789065701.972677:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257932032:0@lo:103: 00000100:00100000:1.0:1789065701.972696:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789065701.972708:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932288:12345-0@lo:501: 00000100:00100000:1.0:1789065701.973425:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932288:12345-0@lo:501: Request processed in 717us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065701.973436:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789065701.973595:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932288:0@lo:501: 00000100:00100000:3.0:1789065701.973658:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932416:0@lo:503: 00000100:00100000:3.0:1789065701.973715:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065701.973754:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065701.973825:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932416 00000100:00100000:0.0:1789065701.973833:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932416 00000100:00100000:0.0:1789065701.973880:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789065701.973889:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932416:12345-0@lo:503: 00000100:00100000:0.0:1789065701.974115:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932416:12345-0@lo:503: Request processed in 226us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065701.974123:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789065701.977821:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932416:0@lo:503: 00000040:00080000:1.0:1789065701.978599:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789065701.978687:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932544:0@lo:502: 00000100:00100000:1.0:1789065701.978780:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065701.978839:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051aff600 going to sleep for 11 seconds 00000100:00100000:2.0:1789065701.979188:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932544 00000100:00100000:2.0:1789065701.979214:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932544 00000100:00100000:2.0:1789065701.979294:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789065701.979307:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932544:12345-0@lo:502: 00000100:00100000:2.0:1789065701.979694:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932544:12345-0@lo:502: Request processed in 389us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065701.979703:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789065701.979992:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932544:0@lo:502: 00000040:00080000:1.0:1789065701.980387:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789065701.980453:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789065701.980486:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789065701.980530:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789065701.980599:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789065701.980630:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789065701.980664:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932672:0@lo:502: 00000100:00100000:1.0:1789065701.980737:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065701.980782:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051aff600 going to sleep for 11 seconds 00000100:00100000:3.0:1789065701.981056:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932672 00000100:00100000:3.0:1789065701.981069:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932672 00000100:00100000:3.0:1789065701.981134:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789065701.981143:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932672:12345-0@lo:502: 00000100:00100000:3.0:1789065701.981454:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932672:12345-0@lo:502: Request processed in 311us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065701.981462:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789065701.982213:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932672:0@lo:502: 00000040:00080000:1.0:1789065701.982433:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789065701.982460:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:0.0:1789065701.984002:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789065701.984019:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1789065701.984034:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065701.984037:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1789065701.984046:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789065701.984081:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cf07eed4d40) 00000020:00000080:0.0:1789065701.984111:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:0.0:1789065701.984118:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789065701.984222:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07a795800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1789065701.984242:0:6702:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:0.0:1789065701.984251:0:6702:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7555615576c82421 00010000:00010000:0.0:1789065701.991953:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:0.0:1789065701.992839:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789065701.996921:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789065701.998041:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789065702.007267:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789065702.008270:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789065702.014975:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789065702.014994:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065702.015001:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065702.015004:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789065702.015007:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789065702.015012:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065702.015013:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789065702.015016:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789065702.015018:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789065702.015101:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065702.015106:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065702.015107:0:6702:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789065702.015110:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1789065702.015338:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1789065702.015374:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789065702.015399:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065702.015414:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789065702.015440:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07a795800 from 1 10000000:01000000:1.0:1789065702.015443:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789065702.015499:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065702.015507:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065702.015521:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065702.015565:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932800:0@lo:101: 00000100:00100000:1.0:1789065702.015667:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065702.015728:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051aff600 going to sleep for 11 seconds 00000100:00100000:1.0:1789065702.019669:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932800 00000100:00100000:1.0:1789065702.019690:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932800 00000100:00100000:1.0:1789065702.019770:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789065702.019784:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:6683:x1875971257932800:12345-0@lo:101: 00010000:00010000:1.0:1789065702.019809:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065702.019833:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82428 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065702.019901:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82428 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065702.019915:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82428 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065702.019926:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072400, rc 0) 00000100:00100000:1.0:1789065702.020035:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257932800:12345-0@lo:101: Request processed in 254us (4368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065702.020043:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789065702.020352:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932800:0@lo:101: 00010000:00010000:2.0:1789065702.020377:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.020644:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065702.020811:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932928:0@lo:501: 00000100:00100000:2.0:1789065702.020868:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065702.020917:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a8d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789065702.021832:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257932928 00000100:00100000:1.0:1789065702.021844:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257932928 00000100:00100000:1.0:1789065702.021900:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789065702.021911:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257932928:12345-0@lo:501: 00000100:00100000:2.0:1789065702.023685:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257932928:0@lo:501: 00000100:00100000:2.0:1789065702.023761:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933056:0@lo:503: 00000100:00100000:2.0:1789065702.023832:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065702.023876:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a8d6900 going to sleep for 11 seconds 00000100:00100000:1.0:1789065702.024300:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257932928:12345-0@lo:501: Request processed in 1593us (2633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065702.024316:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789065702.024367:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933056 00000100:00100000:1.0:1789065702.024375:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933056 00000100:00100000:1.0:1789065702.024679:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789065702.024691:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933056:12345-0@lo:503: 00000100:00100000:1.0:1789065702.024969:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933056:12345-0@lo:503: Request processed in 280us (1136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065702.024976:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789065702.025905:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933056:0@lo:503: 00000040:00080000:2.0:1789065702.026892:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789065702.027026:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933184:0@lo:502: 00000100:00100000:2.0:1789065702.027118:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065702.027170:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0460fbc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065702.027737:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933184 00000100:00100000:3.0:1789065702.027749:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933184 00000100:00100000:3.0:1789065702.027806:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789065702.027817:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933184:12345-0@lo:502: 00000100:00100000:3.0:1789065702.028092:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933184:12345-0@lo:502: Request processed in 277us (973us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065702.028101:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789065702.028336:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933184:0@lo:502: 00000040:00080000:0.0:1789065702.028947:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789065702.029012:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789065702.029053:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933312:0@lo:502: 00000100:00100000:0.0:1789065702.029123:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065702.029166:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0607106c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065702.030988:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933312 00000100:00100000:3.0:1789065702.031003:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933312 00000100:00100000:3.0:1789065702.031074:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789065702.031086:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933312:12345-0@lo:502: 00000100:00100000:3.0:1789065702.031420:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933312:12345-0@lo:502: Request processed in 335us (2296us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065702.031430:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789065702.031521:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818dad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933312:0@lo:502: 00000040:00080000:3.0:1789065702.031739:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789065702.031766:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:3.0:1789065702.032159:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789065702.032172:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065702.032175:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789065702.032183:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf07a795800 00000020:00000080:3.0:1789065702.032185:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789065702.032206:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065702.032210:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065702.032211:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1789065702.032213:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789065702.032267:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789065702.032288:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789065702.032306:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065702.032320:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065702.032361:0:6683:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789065702.032364:0:6683:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf07a795800 10000000:01000000:3.0:1789065702.032367:0:6683:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf07a795800 10000000:01000000:3.0:1789065702.032371:0:6683:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789065702.032377:0:6683:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf07a795800 from 1 10000000:01000000:3.0:1789065702.032380:0:6683:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789065702.032420:0:6683:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065702.032429:0:6683:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065702.032440:0:6683:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065702.032472:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933440:0@lo:101: 00000100:00100000:3.0:1789065702.032527:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065702.032593:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065702.032845:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933440 00000100:00100000:0.0:1789065702.032854:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933440 00000100:00100000:0.0:1789065702.032906:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789065702.032916:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257933440:12345-0@lo:101: 00010000:00010000:0.0:1789065702.032931:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065702.032949:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82436 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065702.032978:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82436 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065702.032992:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82436 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065702.033014:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030c00, rc 0) 00000100:00100000:0.0:1789065702.033058:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933440:12345-0@lo:101: Request processed in 143us (529us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065702.033065:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789065702.034673:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933440:0@lo:101: 00010000:00010000:3.0:1789065702.034707:0:6683:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065702.034721:0:6683:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065702.034892:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933568:0@lo:501: 00000100:00100000:3.0:1789065702.034960:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065702.035051:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5af00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065702.038663:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933568 00000100:00100000:0.0:1789065702.038686:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933568 00000100:00100000:0.0:1789065702.038827:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789065702.038841:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933568:12345-0@lo:501: 00000100:00100000:0.0:1789065702.039292:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933568:12345-0@lo:501: Request processed in 454us (4330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065702.039302:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789065702.040250:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933568:0@lo:501: 00000100:00100000:3.0:1789065702.040335:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933696:0@lo:503: 00000100:00100000:3.0:1789065702.040411:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065702.040470:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5af00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065702.040898:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933696 00000100:00100000:1.0:1789065702.040907:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933696 00000100:00100000:1.0:1789065702.040968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789065702.040989:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933696:12345-0@lo:503: 00000100:00100000:1.0:1789065702.041252:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933696:12345-0@lo:503: Request processed in 265us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065702.041260:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789065702.041651:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933696:0@lo:503: 00000040:00080000:3.0:1789065702.042039:0:6683:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789065702.042127:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933824:0@lo:502: 00000100:00100000:3.0:1789065702.042188:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065702.042237:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5af00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065702.042270:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933824 00000100:00100000:3.0:1789065702.042278:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933824 00000100:00100000:3.0:1789065702.042306:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789065702.042320:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933824:12345-0@lo:502: 00000100:00100000:3.0:1789065702.046185:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933824:12345-0@lo:502: Request processed in 3853us (3985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065702.046219:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789065702.046788:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933824:0@lo:502: 00000040:00080000:0.0:1789065702.047191:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789065702.047296:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789065702.047349:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789065702.048840:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789065702.048945:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789065702.049000:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789065702.049039:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789065702.049103:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789065702.049158:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789065702.049190:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789065702.049316:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789065702.049369:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789065702.050374:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789065702.050958:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789065702.051041:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789065702.051078:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789065702.051111:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789065702.051161:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789065702.051288:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789065702.051330:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789065702.051381:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789065702.051752:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789065702.051788:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789065702.051879:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789065702.051919:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789065702.051955:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789065702.052008:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789065702.052047:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789065702.052121:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933952:0@lo:502: 00000100:00100000:1.0:1789065702.052305:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065702.052450:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535f7780 going to sleep for 11 seconds 00000100:00100000:0.0:1789065702.052866:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257933952 00000100:00100000:0.0:1789065702.052878:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257933952 00000100:00100000:1.0:1789065702.053053:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789065702.053063:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933952:12345-0@lo:502: 00000100:00100000:1.0:1789065702.053363:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257933952:12345-0@lo:502: Request processed in 300us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065702.053371:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789065702.053495:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257933952:0@lo:502: 00000040:00080000:2.0:1789065702.053664:0:6683:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:2.0:1789065702.053680:0:6683:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789065702.055147:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789065702.055169:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cf06a513380) 00000020:00000080:2.0:1789065702.055209:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789065702.055321:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07a795800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789065702.055325:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf07a795800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789065702.055329:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf07a795800 3 00010000:00080000:2.0:1789065702.055364:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf07f179000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065702.057510:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789065702.065104:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789065702.065192:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789065702.065219:0:6707:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7555615576c8244b 00000100:00080000:2.0:1789065702.065245:0:6707:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789065702.065261:0:6707:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cf07f179000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065702.065315:0:6707:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf058215f80 x1875971257934080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789065702.065358:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789065702.065469:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3294:1875971257934080:0@lo:38: 00000100:00100000:3.0:1789065702.065607:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065702.065694:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934080 00000100:00100000:3.0:1789065702.065703:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934080 00000100:00100000:3.0:1789065702.065909:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789065702.065918:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3294:x1875971257934080:12345-0@lo:38: 00010000:00080000:3.0:1789065702.065948:0:5838:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 161 last 0 00000020:00000080:3.0:1789065702.065987:0:5838:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7555615576c82452 00000004:00100000:3.0:1789065702.066006:0:5838:0:(mdt_handler.c:7356:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789065702.066045:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9cf073886000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789065702.066119:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875971257934080:12345-0@lo:38: Request processed in 199us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065702.066125:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789065702.067362:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf058215f80 x1875971257934080/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789065712 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065702.067379:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789065702.067707:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1789065702.067720:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789065702.067727:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789065702.067731:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07f179000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789065702.067740:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3294:1875971257934080:0@lo:38: 00000040:00080000:2.0:1789065702.067979:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:2.0:1789065702.068651:0:6683:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:2.0:1789065702.068687:0:6683:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789065702.068714:0:6683:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.068727:0:6683:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789065702.068908:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789065702.068911:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789065702.068913:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789065702.068914:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789065702.068915:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789065702.068917:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789065702.068922:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789065702.068923:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789065702.068924:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789065702.068926:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789065702.068927:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789065702.068932:0:6683:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1789065702.068935:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789065702.068936:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789065702.068937:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789065702.068938:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789065702.068939:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789065702.068940:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789065702.068941:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789065702.068942:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789065702.068943:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789065702.068943:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789065702.068944:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789065702.069043:0:6683:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789065702.069067:0:6683:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257934208:0@lo:253: 00000100:00100000:2.0:1789065702.069158:0:6683:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065702.069181:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934208 00000100:00100000:3.0:1789065702.069189:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934208 00000100:00100000:2.0:1789065702.069198:0:6683:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a8d6900 going to sleep for 11 seconds 00000100:00100000:3.0:1789065702.069253:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789065702.069264:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6683:x1875971257934208:12345-0@lo:253: 20000000:01000000:3.0:1789065702.069315:0:5833:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789065702.069334:0:5833:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1789065702.070280:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257934336:0@lo:400: 00000100:00100000:0.0:1789065702.070360:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065702.070438:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934336 00000100:00100000:0.0:1789065702.070444:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934336 00000100:00100000:0.0:1789065702.070485:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065702.070493:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257934336:12345-0@lo:400: 00000100:00100000:0.0:1789065702.070575:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257934336:12345-0@lo:400: Request processed in 82us (214us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065702.070582:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789065702.070633:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf0818da300 x1875971257934336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065718 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065702.070647:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257934336:0@lo:400: 20000000:01000000:3.0:1789065702.141911:0:5833:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789065702.141936:0:5833:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789065702.142076:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789065702.142081:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789065702.142111:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.142134:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c823b1 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.142144:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.142213:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c823b1 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.142241:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c823b1 expref: 13 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065702.142280:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875971257934464:0@lo:104: 00000100:00100000:2.0:1789065702.142368:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065702.142463:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050e53a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065702.143168:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934464 00000100:00100000:3.0:1789065702.143181:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934464 00000100:00100000:3.0:1789065702.143822:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789065702.143835:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5854:x1875971257934464:12345-0@lo:104: 00010000:00010000:3.0:1789065702.143860:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065702.143958:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789065702.143965:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5854:x1875971257934464:12345-0@lo:104: Request processed in 133us (1597us total) trans 0 rc 0/0 00010000:00010000:2.0:1789065702.144508:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065702.144518:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.144528:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031a00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065702.144533:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.144544:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065702.144576:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065702.144582:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789065702.144639:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.144647:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065702.144673:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.144681:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c823b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c823b8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.144707:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065702.144722:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065702.144725:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065702.144744:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257934592:0@lo:103: 00000100:00100000:2.0:1789065702.144807:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065702.144888:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934592 00000100:00100000:2.0:1789065702.144896:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934592 00010000:00010000:2.0:1789065702.144924:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c823b1 expref: 14 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065702.144955:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789065702.144963:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3296:x1875971257934592:12345-0@lo:103: 00000100:00100000:3.0:1789065702.147148:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789065702.148164:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065702.148183:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c823b1 expref: 14 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148216:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c823b1 expref: 14 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148259:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148271:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789065702.148300:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006219330s 00010000:00010000:2.0:1789065702.148305:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148312:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148343:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148350:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148357:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fd000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065702.148362:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148371:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148381:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065702.148410:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065702.148520:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e0b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3296:x1875971257934592:12345-0@lo:103: Request processed in 3555us (3709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065702.148531:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789065702.148671:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058217480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257934592:0@lo:103: 00010000:00010000:0.0:1789065702.148887:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fc200/0x7555615576c823b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c823b1 expref: 13 pid: 5833 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065702.148906:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875971257934464:0@lo:104: 00010000:00010000:0.0:1789065702.148923:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065702.148933:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065702.148939:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065702.148946:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fd000/0x7555615576c82459 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065702.192918:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:6683:x1875971257934208:12345-0@lo:253: Request processed in 123640us (123744us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065702.192938:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789065702.198614:0:6683:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6683:1875971257934208:0@lo:253: 10000000:01000000:2.0:1789065702.198644:0:6683:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789065702.198648:0:6683:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789065702.198650:0:6683:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789065702.198652:0:6683:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789065702.198654:0:6683:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789065702.198655:0:6683:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789065702.198657:0:6683:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789065702.198682:0:6683:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789065702.198683:0:6683:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789065702.198685:0:6683:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789065702.198687:0:6683:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789065702.198689:0:6683:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789065702.198715:0:6683:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789065702.215689:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065702.216035:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789065702.216358:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065702.222304:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789065702.223072:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789065702.224019:0:6683:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1789065702.239855:0:6683:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789065702.377528:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789065702.532239:0:6683:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789065702.532248:0:6683:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789065702.532291:0:6683:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789065702.532348:0:6683:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789065702.532362:0:6683:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789065702.532389:0:6683:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789065703.398683:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065704.423084:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065705.450664:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789065705.451506:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789065705.451511:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf04c2a4800 from 21 10000000:01000000:0.0:1789065705.451516:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789065705.451582:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.451594:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.451605:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.451635:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257934720:0@lo:101: 00000100:00100000:0.0:1789065705.451699:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065705.452376:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934720 00000100:00100000:1.0:1789065705.452386:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934720 00000100:00100000:0.0:1789065705.452476:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.452543:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789065705.452576:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257934720:12345-0@lo:101: 00010000:00010000:1.0:1789065705.452589:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065705.452604:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82460 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065705.452631:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82460 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065705.452642:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82460 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065705.452652:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073000, rc 0) 00000100:00100000:1.0:1789065705.452703:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257934720:12345-0@lo:101: Request processed in 131us (1003us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065705.452710:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789065705.452927:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257934720:0@lo:101: 00010000:00010000:0.0:1789065705.452943:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.452951:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.453009:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257934848:0@lo:501: 00000100:00100000:0.0:1789065705.453037:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.453394:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283dcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.464022:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934848 00000100:00100000:1.0:1789065705.464036:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934848 00000100:00100000:1.0:1789065705.465240:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789065705.465265:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257934848:12345-0@lo:501: 00000100:00100000:1.0:1789065705.465726:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257934848:12345-0@lo:501: Request processed in 464us (12686us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065705.465734:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789065705.468592:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257934848:0@lo:501: 00000100:00100000:0.0:1789065705.468650:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257934976:0@lo:503: 00000100:00100000:0.0:1789065705.468733:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.471246:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065705.473315:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257934976 00000100:00100000:2.0:1789065705.473328:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257934976 00000100:00100000:2.0:1789065705.473381:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789065705.473392:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257934976:12345-0@lo:503: 00000100:00100000:2.0:1789065705.473831:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257934976:12345-0@lo:503: Request processed in 440us (5097us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.473840:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789065705.473904:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818da300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257934976:0@lo:503: 00000100:00100000:2.0:1789065705.474105:0:6855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6855:1875971257935104:0@lo:502: 00000100:00100000:2.0:1789065705.475283:0:6855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065705.475333:0:6855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce3d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.475390:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935104 00000100:00100000:1.0:1789065705.475398:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935104 00000100:00100000:1.0:1789065705.475445:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789065705.475453:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6855:x1875971257935104:12345-0@lo:502: 00000100:00100000:1.0:1789065705.475775:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6855:x1875971257935104:12345-0@lo:502: Request processed in 311us (483us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065705.475783:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789065705.476660:0:6855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6855:1875971257935104:0@lo:502: 00000100:00100000:2.0:1789065705.476729:0:6855:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6855:1875971257935232:0@lo:502: 00000100:00100000:2.0:1789065705.476786:0:6855:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065705.476814:0:6855:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce3d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789065705.476933:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935232 00000100:00100000:0.0:1789065705.476939:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935232 00000100:00100000:0.0:1789065705.476969:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789065705.476977:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6855:x1875971257935232:12345-0@lo:502: 00000100:00100000:0.0:1789065705.477289:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:6855:x1875971257935232:12345-0@lo:502: Request processed in 312us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.477296:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789065705.477373:0:6855:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6855:1875971257935232:0@lo:502: 00000040:00080000:2.0:1789065705.477402:0:6855:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789065705.478268:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789065705.478293:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789065705.478302:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.478314:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065705.478324:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789065705.478327:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf04c2a4800 from 4 10000000:01000000:0.0:1789065705.478330:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789065705.478360:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.478368:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.478378:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.478393:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935360:0@lo:101: 00000100:00100000:0.0:1789065705.478640:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.478672:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065705.478869:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935360 00000100:00100000:2.0:1789065705.478875:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935360 00000100:00100000:2.0:1789065705.478920:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789065705.478928:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257935360:12345-0@lo:101: 00010000:00010000:2.0:1789065705.478938:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065705.478952:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8246e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.478974:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8246e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.478986:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8246e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.478994:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0413fd000, rc 0) 00000100:00100000:2.0:1789065705.484492:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257935360:12345-0@lo:101: Request processed in 5554us (5841us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.484506:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789065705.487803:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935360:0@lo:101: 00010000:00010000:0.0:1789065705.487832:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.487844:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.487914:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935488:0@lo:256: 00000100:00100000:0.0:1789065705.487986:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.488042:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283de40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065705.488172:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935488 00000100:00100000:2.0:1789065705.488180:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935488 00000100:00100000:2.0:1789065705.488233:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789065705.488245:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257935488:12345-0@lo:256: 20000000:01000000:2.0:1789065705.488267:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789065705.488282:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789065705.488285:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:2.0:1789065705.488373:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257935488:12345-0@lo:256: Request processed in 130us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.488381:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789065705.490019:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935488:0@lo:256: 10000000:01000000:0.0:1789065705.490077:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789065705.490088:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.490098:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065705.490107:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789065705.490110:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789065705.490112:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789065705.490282:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.490291:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.490300:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.490316:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935616:0@lo:101: 00000100:00100000:0.0:1789065705.490365:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.490399:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065705.491115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935616 00000100:00100000:2.0:1789065705.491124:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935616 00000100:00100000:2.0:1789065705.491194:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789065705.491203:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257935616:12345-0@lo:101: 00010000:00010000:2.0:1789065705.491217:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065705.491231:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8247c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.491254:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8247c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.491264:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8247c expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.491272:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0413fd200, rc 0) 00000100:00100000:2.0:1789065705.491315:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257935616:12345-0@lo:101: Request processed in 113us (950us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.491322:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789065705.491468:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935616:0@lo:101: 00010000:00010000:1.0:1789065705.491483:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065705.491492:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065705.491574:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935744:0@lo:501: 00000100:00100000:1.0:1789065705.491604:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065705.491630:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f2aa900 going to sleep for 11 seconds 00000100:00100000:0.0:1789065705.491742:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935744 00000100:00100000:0.0:1789065705.491748:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935744 00000100:00100000:0.0:1789065705.491790:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789065705.491798:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257935744:12345-0@lo:501: 00000100:00100000:0.0:1789065705.492074:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257935744:12345-0@lo:501: Request processed in 277us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.492082:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789065705.492113:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935744:0@lo:501: 00000100:00100000:0.0:1789065705.492308:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935872:0@lo:503: 00000100:00100000:0.0:1789065705.492345:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.494430:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.500250:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257935872 00000100:00100000:1.0:1789065705.500266:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257935872 00000100:00100000:2.0:1789065705.500722:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789065705.500734:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257935872:12345-0@lo:503: 00000100:00100000:2.0:1789065705.501504:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257935872:12345-0@lo:503: Request processed in 769us (9155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.501514:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789065705.501600:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257935872:0@lo:503: 00000100:00100000:2.0:1789065705.502385:0:6858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6858:1875971257936000:0@lo:502: 00000100:00100000:2.0:1789065705.502451:0:6858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065705.502499:0:6858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cef4283de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.502624:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936000 00000100:00100000:1.0:1789065705.502631:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936000 00000100:00100000:1.0:1789065705.502666:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789065705.502674:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:6858:x1875971257936000:12345-0@lo:502: 00000100:00100000:1.0:1789065705.502963:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:6858:x1875971257936000:12345-0@lo:502: Request processed in 289us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065705.502971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789065705.503171:0:6858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6858:1875971257936000:0@lo:502: 00000020:01000000:2.0:1789065705.503207:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789065705.503214:0:6858:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789065705.503221:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065705.503223:0:6858:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789065705.503228:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789065705.503231:0:6858:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:2.0:1789065705.503256:0:6858:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789065705.503259:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789065705.503274:0:6858:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cf06a514d40) 00000020:00000080:2.0:1789065705.503295:0:6858:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1789065705.503300:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789065705.503385:0:6858:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789065705.503391:0:6858:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789065705.503398:0:6858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c82491 00010000:00080000:2.0:1789065705.503540:0:6858:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf074ee1000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065705.504496:0:6858:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789065705.609351:0:6858:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789065705.609375:0:6858:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789065705.609940:0:6858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789065705.612781:0:6858:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789065705.612864:0:6858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789065705.612929:0:6858:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:2.0:1789065705.613781:0:6861:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065705.613787:0:6861:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789065705.624808:0:6858:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065705.624826:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789065705.624872:0:6858:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789065705.624895:0:6858:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c82498 00000100:00080000:3.0:1789065705.624906:0:6858:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789065705.624919:0:6858:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf074ee1000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789065705.624955:0:6858:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07a748a80 x1875971257936128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789065705.624979:0:6858:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789065705.625047:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065705.625051:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065705.625053:0:6858:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789065705.625056:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789065705.625059:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065705.625060:0:6858:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789065705.625063:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789065705.625064:0:6858:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789065705.625103:0:6858:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a748e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6858:1875971257936256:0@lo:502: 00000100:00100000:2.0:1789065705.625246:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971257936128:0@lo:8: 00000100:00100000:2.0:1789065705.625310:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065705.625380:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936128 00000100:00100000:2.0:1789065705.625386:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936128 00000100:00100000:2.0:1789065705.625417:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789065705.625425:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3294:x1875971257936128:12345-0@lo:8: 00010000:00080000:2.0:1789065705.625449:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 164 last 0 00000020:00000080:2.0:1789065705.625477:0:6685:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c8249f 00002000:00100000:2.0:1789065705.625510:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cf075f69800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789065705.625515:0:6685:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:2.0:1789065705.625525:0:6685:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1789065705.625672:0:6685:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789065705.625868:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789065705.625894:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9cf075f6f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789065705.625945:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875971257936128:12345-0@lo:8: Request processed in 519us (635us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.625952:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789065705.625990:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07a748a80 x1875971257936128/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789065715 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065705.626000:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789065705.626006:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:2.0:1789065705.626013:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789065705.626017:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789065705.626019:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf074ee1000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789065705.626028:0:3294:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789065705.626032:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971257936128:0@lo:8: 00000004:00080000:2.0:1789065705.626053:0:6861:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1789065705.626832:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257936512:0@lo:400: 00000100:00100000:0.0:1789065705.626878:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.626910:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789065705.626917:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257936384:0@lo:400: 00000100:00100000:0.0:1789065705.626939:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.626973:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936512 00000100:00100000:0.0:1789065705.626979:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936512 00000100:00100000:0.0:1789065705.627019:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936384 00000100:00100000:0.0:1789065705.627023:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936384 00000100:00100000:0.0:1789065705.627038:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789065705.627046:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257936512:12345-0@lo:400: 00000100:00100000:0.0:1789065705.627304:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257936512:12345-0@lo:400: Request processed in 258us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.627312:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789065705.627336:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789065705.627342:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257936384:12345-0@lo:400: 00000100:00100000:0.0:1789065705.627372:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257936384:12345-0@lo:400: Request processed in 30us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.627379:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789065705.627407:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d8a80 x1875971257936384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065705.627418:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257936384:0@lo:400: 00010000:00080000:0.0:1789065705.627429:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d8700 x1875971257936512/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065721 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065705.627436:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257936512:0@lo:400: 00000100:00100000:3.0:1789065705.628394:0:6858:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065705.628426:0:6858:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437ce0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065705.628691:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936256 00000100:00100000:0.0:1789065705.628698:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936256 00000100:00100000:0.0:1789065705.628737:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789065705.628744:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:6858:x1875971257936256:12345-0@lo:502: 00000100:00100000:0.0:1789065705.628986:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:6858:x1875971257936256:12345-0@lo:502: Request processed in 240us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.628993:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789065705.629398:0:6858:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a748e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:6858:1875971257936256:0@lo:502: 00000020:01000000:3.0:1789065705.629433:0:6858:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065705.629441:0:6858:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065705.629443:0:6858:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789065705.629448:0:6858:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000100:00080000:2.0:1789065705.629910:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000000:0.0:1789065705.630245:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789065705.630274:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789065705.630288:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.630300:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065705.630327:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789065705.630330:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf0581e4d40 from 1 10000000:01000000:0.0:1789065705.630333:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789065705.630368:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.630375:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.630384:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.630405:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257936640:0@lo:101: 00000100:00100000:0.0:1789065705.630452:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.630490:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06060f840 going to sleep for 11 seconds 00000100:00100000:2.0:1789065705.630878:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936640 00000100:00100000:2.0:1789065705.630886:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936640 00000100:00100000:2.0:1789065705.630921:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789065705.630929:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257936640:12345-0@lo:101: 00010000:00010000:2.0:1789065705.630942:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065705.630956:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c824a6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.630979:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c824a6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.631003:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824a6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.631012:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0413fc800, rc 0) 00000100:00100000:2.0:1789065705.631056:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257936640:12345-0@lo:101: Request processed in 128us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.631062:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789065705.631118:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257936640:0@lo:101: 00010000:00010000:2.0:1789065705.633303:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065705.633322:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065705.633422:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058217480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257936768:0@lo:501: 00000100:00100000:2.0:1789065705.633482:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065705.633527:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f2aa240 going to sleep for 11 seconds 00000004:00080000:2.0:1789065705.633597:0:6861:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 164827048054ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789065705.633776:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936768 00000100:00100000:3.0:1789065705.633784:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936768 00000100:00100000:3.0:1789065705.633819:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789065705.633827:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257936768:12345-0@lo:501: 00000100:00100000:3.0:1789065705.635443:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257936768:12345-0@lo:501: Request processed in 1608us (1952us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789065705.635457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789065705.647820:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058217480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257936768:0@lo:501: 10000000:01000000:0.0:1789065705.647898:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789065705.647910:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065705.647922:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065705.713670:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257936896:0@lo:13: 00000100:00100000:0.0:1789065705.713751:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.713860:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257936896 00000100:00100000:0.0:1789065705.713869:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257936896 00000100:00100000:0.0:1789065705.713934:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065705.713944:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257936896:12345-0@lo:13: 00002000:00000024:0.0:1789065705.713981:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1789065705.714027:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257936896:12345-0@lo:13: Request processed in 85us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.714035:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789065705.714055:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065705.714086:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d8a80 x1875971257936896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065721 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065705.714106:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257936896:0@lo:13: 00000004:00080000:0.0:1789065705.714138:0:6863:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1789065705.714168:0:6863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937024:0@lo:7: 00000100:00100000:0.0:1789065705.714196:0:6863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065705.714220:0:6863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0504f2240 going to sleep for 11 seconds 00000100:00100000:3.0:1789065705.722796:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937024 00000100:00100000:3.0:1789065705.722814:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937024 00000100:00100000:3.0:1789065705.722869:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789065705.722879:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6863:x1875971257937024:12345-0@lo:7: 00002000:00080000:2.0:1789065705.748043:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1789065705.748052:0:6688:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789065705.748171:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6863:x1875971257937024:12345-0@lo:7: Request processed in 25280us (33959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065705.748182:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789065705.749188:0:6863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d8a80 x1875971257937024/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789065721 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065705.749205:0:6863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937024:0@lo:7: 00000004:00080000:1.0:1789065705.749222:0:6863:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1789065705.749257:0:6863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937152:0@lo:5: 00000100:00100000:1.0:1789065705.749299:0:6863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065705.749340:0:6863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1a3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.749364:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937152 00000100:00100000:1.0:1789065705.749369:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937152 00000100:00100000:1.0:1789065705.749402:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789065705.749411:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6863:x1875971257937152:12345-0@lo:5: 00002000:00080000:1.0:1789065705.749438:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789065705.749441:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789065705.749751:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:6863:x1875971257937152:12345-0@lo:5: Request processed in 340us (451us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789065705.749758:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789065705.749814:0:6863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae65f80 x1875971257937152/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789065721 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065705.749825:0:6863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937152:0@lo:5: 00000004:00080000:1.0:1789065705.749833:0:6863:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1789065705.749857:0:6863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937280:0@lo:700: 00000100:00100000:1.0:1789065705.749880:0:6863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065705.749911:0:6863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1a3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.749930:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937280 00000100:00100000:1.0:1789065705.749934:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937280 00000100:00100000:1.0:1789065705.749959:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789065705.749966:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6863:x1875971257937280:12345-0@lo:700: 00000100:00100000:1.0:1789065705.749994:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae67100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875971257937408:0@lo:700: 00000100:00100000:1.0:1789065705.750038:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065705.750054:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1a3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789065705.750076:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937408 00000100:00100000:1.0:1789065705.750079:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937408 00000100:00100000:1.0:1789065705.750102:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789065705.750108:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875971257937408:12345-0@lo:700: 00000004:00080000:0.0:1789065705.764613:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 40000000:02000000:0.0:1789065705.878041:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:0.0:1789065705.883066:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6694:x1875971257937408:12345-0@lo:700: Request processed in 132948us (133018us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.883110:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789065705.883505:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae67100 x1875971257937408/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789065721 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065705.883521:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae67100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6694:1875971257937408:0@lo:700: 40000000:02000000:1.0:1789065705.883535:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000100:00100000:0.0:1789065705.972630:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6863:x1875971257937280:12345-0@lo:700: Request processed in 222657us (222742us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065705.972647:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000001:00080000:1.0:1789065705.972767:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:1.0:1789065705.972784:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00080000:1.0:1789065705.972829:0:6863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae66300 x1875971257937280/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789065721 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065705.972845:0:6863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae66300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937280:0@lo:700: 00000004:02000040:1.0:1789065706.024535:0:6863:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:0.0:1789065706.031591:0:6863:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937536:0@lo:5: 00000100:00100000:0.0:1789065706.031659:0:6863:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065706.031719:0:6863:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf043207c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789065706.031936:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937536 00000100:00100000:2.0:1789065706.031945:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937536 00000100:00100000:2.0:1789065706.032012:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065706.032022:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6863:x1875971257937536:12345-0@lo:5: 00000100:00100000:1.0:1789065706.032090:0:6687:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789065706.032209:0:6687:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:0.0:1789065706.044394:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789065706.044415:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:0.0:1789065706.049106:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6863:x1875971257937536:12345-0@lo:5: Request processed in 17079us (17441us total) trans 4294967298 rc 0/0 00010000:00080000:1.0:1789065706.049267:0:6863:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d9c00 x1875971257937536/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789065722 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065706.049299:0:6863:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1789065706.049316:0:6863:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf0818d9c00 x1875971257937536/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789065722 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065706.049330:0:6863:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6863:1875971257937536:0@lo:5: 00000004:00080000:1.0:1789065706.049345:0:6863:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:0.0:1789065706.049427:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789065706.470522:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065707.493987:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065708.518652:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789065709.305041:0:7055:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789065709.545159:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065710.574351:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065710.757746:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065710.757769:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257937664:0@lo:13: 00000100:00100000:0.0:1789065710.757838:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065710.757897:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937664 00000100:00100000:0.0:1789065710.757905:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937664 00000100:00100000:2.0:1789065710.758274:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257937792:0@lo:400: 00000100:00100000:2.0:1789065710.758312:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065710.758337:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065710.758342:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257937920:0@lo:400: 00000100:00100000:2.0:1789065710.758364:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065710.759329:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789065710.759367:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257938048:0@lo:400: 00000100:00100000:3.0:1789065710.759417:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065710.759652:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937920 00000100:00100000:2.0:1789065710.759660:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937920 00000100:00100000:2.0:1789065710.759705:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938048 00000100:00100000:2.0:1789065710.759708:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938048 00000100:00100000:2.0:1789065710.759731:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789065710.759738:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257937920:12345-0@lo:400: 00000100:00100000:2.0:1789065710.759801:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257937920:12345-0@lo:400: Request processed in 63us (1435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065710.759809:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789065710.759826:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789065710.759832:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257938048:12345-0@lo:400: 00000100:00100000:2.0:1789065710.759864:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257938048:12345-0@lo:400: Request processed in 33us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065710.759870:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789065710.759903:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf058214a80 x1875971257938048/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065710.759915:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257938048:0@lo:400: 00010000:00080000:2.0:1789065710.759944:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf058214700 x1875971257937920/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065726 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065710.759960:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257937920:0@lo:400: 00000100:00100000:0.0:1789065710.763245:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789065710.763266:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257937664:12345-0@lo:13: 00002000:00000024:0.0:1789065710.763307:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065710.763386:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257937664:12345-0@lo:13: Request processed in 126us (5546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065710.763392:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789065710.763419:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789065710.763424:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065710.763446:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257937792 00000100:00100000:0.0:1789065710.763453:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257937792 00000100:00100000:0.0:1789065710.763498:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789065710.763505:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3297:x1875971257937792:12345-0@lo:400: 00000100:00100000:0.0:1789065710.763567:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3297:x1875971257937792:12345-0@lo:400: Request processed in 43us (5234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065710.763573:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1789065710.763626:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d9f80 x1875971257937664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065710.763646:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257937664:0@lo:13: 00000100:00100000:0.0:1789065710.763681:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257937792:0@lo:400: 00000001:00080000:1.0:1789065711.418462:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1789065711.593932:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065712.613860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065713.639467:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065714.664722:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065715.686681:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065715.881006:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257938560:0@lo:400: 00000100:00100000:0.0:1789065715.881088:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065715.881159:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065715.881166:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257938176:0@lo:400: 00000100:00100000:0.0:1789065715.881194:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065715.881224:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257938304:0@lo:400: 00000100:00100000:0.0:1789065715.881251:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065715.881268:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065715.881273:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257938432:0@lo:400: 00000100:00100000:0.0:1789065715.881291:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065715.881614:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938560 00000100:00100000:0.0:1789065715.881621:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938560 00000100:00100000:0.0:1789065715.881685:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065715.881695:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257938560:12345-0@lo:400: 00000100:00100000:0.0:1789065715.881748:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257938560:12345-0@lo:400: Request processed in 54us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065715.881755:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789065715.881774:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065715.881800:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d8380 x1875971257938560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065715.881810:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789065715.881823:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257938560:0@lo:400: 00000100:00100000:2.0:1789065715.882223:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257938688:0@lo:13: 00000100:00100000:2.0:1789065715.882259:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065715.882311:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938304 00000100:00100000:2.0:1789065715.882315:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938304 00000100:00100000:2.0:1789065715.882342:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938432 00000100:00100000:2.0:1789065715.882345:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938432 00000100:00100000:2.0:1789065715.882365:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789065715.882371:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257938304:12345-0@lo:400: 00000100:00100000:2.0:1789065715.882410:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257938304:12345-0@lo:400: Request processed in 39us (1158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065715.882416:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789065715.882428:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789065715.882434:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257938432:12345-0@lo:400: 00000100:00100000:2.0:1789065715.882458:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257938432:12345-0@lo:400: Request processed in 25us (1166us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065715.882477:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789065715.882501:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938688 00000100:00100000:2.0:1789065715.882505:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938688 00000100:00100000:2.0:1789065715.882528:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789065715.882533:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257938688:12345-0@lo:13: 00002000:00000024:2.0:1789065715.882580:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065715.882616:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257938688:12345-0@lo:13: Request processed in 82us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065715.882622:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789065715.882660:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789065715.882680:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf058214700 x1875971257938688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065715.882695:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257938688:0@lo:13: 00010000:00080000:2.0:1789065715.882721:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818d9180 x1875971257938432/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065715.882731:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257938432:0@lo:400: 00010000:00080000:2.0:1789065715.882741:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf0818db800 x1875971257938304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065731 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065715.882749:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257938304:0@lo:400: 00000100:00100000:2.0:1789065715.885749:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938176 00000100:00100000:2.0:1789065715.885765:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938176 00000100:00100000:2.0:1789065715.885849:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789065715.885860:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3295:x1875971257938176:12345-0@lo:400: 00000100:00100000:2.0:1789065715.886093:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3295:x1875971257938176:12345-0@lo:400: Request processed in 233us (4896us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065715.886100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789065715.886168:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257938176:0@lo:400: 00010000:00010000:0.0:1789065716.709815:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065717.740222:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065718.757741:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065719.799833:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065720.805827:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065721.005375:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257938816:0@lo:400: 00000100:00100000:1.0:1789065721.005459:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065721.006066:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938816 00000100:00100000:1.0:1789065721.006076:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938816 00000100:00100000:1.0:1789065721.006126:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789065721.006135:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3297:x1875971257938816:12345-0@lo:400: 00000100:00100000:1.0:1789065721.006195:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3297:x1875971257938816:12345-0@lo:400: Request processed in 60us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065721.006201:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789065721.006249:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257938816:0@lo:400: 00000100:00100000:1.0:1789065721.006289:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257938944:0@lo:400: 00000100:00100000:1.0:1789065721.006315:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065721.006346:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257938944 00000100:00100000:1.0:1789065721.006350:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257938944 00000100:00100000:1.0:1789065721.006378:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789065721.006396:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257938944:12345-0@lo:400: 00000100:00100000:1.0:1789065721.006433:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257938944:12345-0@lo:400: Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065721.006438:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789065721.006473:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae65f80 x1875971257938944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065721.006485:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257938944:0@lo:400: 00000100:00100000:1.0:1789065721.006523:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257939072:0@lo:400: 00000100:00100000:1.0:1789065721.006566:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065721.006599:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939072 00000100:00100000:1.0:1789065721.006603:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939072 00000100:00100000:1.0:1789065721.006634:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789065721.006640:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257939072:12345-0@lo:400: 00000100:00100000:1.0:1789065721.006670:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257939072:12345-0@lo:400: Request processed in 31us (123us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065721.006676:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:1.0:1789065721.006692:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789065721.006977:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae65f80 x1875971257939072/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065721.006987:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257939072:0@lo:400: 00000100:00100000:1.0:1789065721.006998:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065721.007004:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257939200:0@lo:13: 00000100:00100000:1.0:1789065721.007032:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065721.007085:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257939328:0@lo:400: 00000100:00100000:1.0:1789065721.007111:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065721.007152:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939328 00000100:00100000:1.0:1789065721.007157:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939328 00000100:00100000:1.0:1789065721.007190:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065721.007196:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257939328:12345-0@lo:400: 00000100:00100000:1.0:1789065721.007231:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257939328:12345-0@lo:400: Request processed in 36us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065721.007236:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1789065721.007252:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789065721.007268:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae64a80 x1875971257939328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065721.007277:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257939328:0@lo:400: 00000100:00100000:2.0:1789065721.008991:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939200 00000100:00100000:2.0:1789065721.009003:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939200 00000100:00100000:2.0:1789065721.009067:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065721.009076:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257939200:12345-0@lo:13: 00002000:00000024:2.0:1789065721.009110:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065721.009180:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257939200:12345-0@lo:13: Request processed in 106us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065721.009187:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789065721.009267:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf058214700 x1875971257939200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065737 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065721.009286:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257939200:0@lo:13: 00010000:00010000:1.0:1789065721.829730:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789065722.601200:0:7619:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789065722.601205:0:7619:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1789065722.601327:0:7619:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf081779000 00000020:01000004:3.0:1789065722.601343:0:7619:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1789065722.601356:0:7619:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1789065722.601370:0:7619:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cf074eacd40) 00000020:00000080:3.0:1789065722.601387:0:7619:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789065722.654400:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1789065722.654691:0:7619:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789065722.694935:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789065722.699350:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789065722.699385:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789065722.699444:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789065722.699471:0:7619:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789065722.699939:0:7619:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789065722.699950:0:7619:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789065722.699964:0:7619:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7555615576c824bb 00000020:01000004:2.0:1789065722.699972:0:7619:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789065722.699993:0:7619:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789065722.699997:0:7619:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789065722.700002:0:7619:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789065722.700023:0:7619:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789065722.700027:0:7619:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789065722.714742:0:7619:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789065722.714782:0:7619:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.123@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1789065722.714786:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789065722.714788:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789065722.714789:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789065722.714790:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789065722.714792:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789065722.714793:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789065722.714794:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789065722.714796:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789065722.714797:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789065722.714798:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789065722.714799:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789065722.714804:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1789065722.714811:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789065722.714812:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789065722.714813:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789065722.714814:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789065722.714815:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789065722.714816:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789065722.714817:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789065722.714818:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789065722.714819:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789065722.714820:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789065722.714821:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789065722.714856:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789065722.714874:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257939456:0@lo:253: 00000100:00100000:2.0:1789065722.714944:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.715105:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789065722.715151:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939456 00000100:00100000:0.0:1789065722.715160:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939456 00000100:00100000:0.0:1789065722.715215:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789065722.715225:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:7619:x1875971257939456:12345-0@lo:253: 20000000:01000000:0.0:1789065722.715253:0:5831:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789065722.715258:0:5831:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789065722.715263:0:5831:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789065722.715266:0:5831:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:2.0:1789065722.716763:0:5831:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789065722.716999:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1789065722.717014:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:2.0:1789065722.717059:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1789065722.717067:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:2.0:1789065722.717098:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1789065722.717149:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1789065722.717583:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1789065722.717604:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:2.0:1789065722.717606:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789065722.717642:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1789065722.717650:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1789065722.717696:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1789065722.717704:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:2.0:1789065722.717735:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1789065722.717745:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789065722.717778:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1789065722.717829:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1789065722.718526:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1789065722.718652:0:5831:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.204.123@tcp 20000000:01000000:2.0:1789065722.718655:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.123@tcp (null) (null) (null) 00000040:00080000:2.0:1789065722.718695:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1789065722.718703:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1789065722.718734:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1789065722.718741:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.123@tcp (null) (null) 00000040:00080000:2.0:1789065722.718771:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1789065722.718779:0:5831:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1789065722.718854:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1789065722.718897:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1789065722.718915:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1789065722.718918:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1789065722.718924:0:5831:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1789065722.718925:0:5831:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1789065722.718928:0:5831:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1789065722.718940:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789065722.718943:0:5831:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789065722.718975:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789065722.718978:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789065722.719516:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1789065722.719590:0:7621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1789065722.719648:0:7621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1789065722.719951:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1789065722.719993:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1789065722.720048:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1789065722.720060:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1789065722.720062:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789065722.720495:0:7622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:2.0:1789065722.720820:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:2.0:1789065722.720872:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:2.0:1789065722.720931:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:2.0:1789065722.720942:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789065722.720944:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789065722.721421:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 15 1->4: lustre sys.timeout 20000000:01000000:1.0:1789065722.721471:0:7623:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 15 2->4: lustre sys.timeout 00000040:00080000:1.0:1789065722.721528:0:7623:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1789065722.721953:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1789065722.721992:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:2.0:1789065722.722023:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:2.0:1789065722.722033:0:5831:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789065722.722040:0:5831:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1789065722.722973:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 16 1->4: lustre sys.timeout 20000000:01000000:1.0:1789065722.723055:0:7624:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 16 2->4: lustre sys.timeout 00000040:00080000:1.0:1789065722.723084:0:7624:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1789065722.723383:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1789065722.723424:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1789065722.723480:0:5831:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 10000000:01000000:2.0:1789065722.723499:0:5831:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1789065722.723519:0:5831:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723537:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8240c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723645:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82436 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723655:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82460 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723661:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8247c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723668:0:5831:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824a6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723675:0:5831:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723716:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c824a6 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723732:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c824a6 expref: 16 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.723747:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939584:0@lo:104: 00000100:00100000:2.0:1789065722.723825:0:5831:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789065722.723944:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8247c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723953:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8247c expref: 16 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.723962:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058217100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939712:0@lo:104: 00010000:00010000:2.0:1789065722.723991:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82460 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.723999:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82460 expref: 16 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.724007:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058217480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939840:0@lo:104: 00010000:00010000:2.0:1789065722.724026:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82436 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.724034:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82436 expref: 16 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.724041:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939968:0@lo:104: 00010000:00010000:2.0:1789065722.724060:0:5831:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8240c expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.724066:0:5831:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8240c expref: 16 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.724073:0:5831:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257940096:0@lo:104: 00000100:00100000:2.0:1789065722.724101:0:5831:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cda80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.724160:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1789065722.724179:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.724240:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.724295:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.724314:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939584 00000100:00100000:0.0:1789065722.724322:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939584 00000100:00100000:0.0:1789065722.724358:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939712 00000100:00100000:0.0:1789065722.724361:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939712 00000100:00100000:0.0:1789065722.724370:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939840 00000100:00100000:0.0:1789065722.724372:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939840 00000100:00100000:0.0:1789065722.724384:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065722.724392:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:5831:x1875971257939584:12345-0@lo:104: 00010000:00010000:0.0:1789065722.724405:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724474:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065722.724480:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508a9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:5831:x1875971257939584:12345-0@lo:104: Request processed in 89us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.724488:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065722.724530:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065722.724537:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:5831:x1875971257939712:12345-0@lo:104: 00010000:00010000:0.0:1789065722.724584:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724621:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789065722.724626:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:5831:x1875971257939712:12345-0@lo:104: Request processed in 90us (446us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.724633:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065722.724646:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789065722.724652:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257939840:12345-0@lo:104: 00010000:00010000:0.0:1789065722.724660:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724690:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789065722.724695:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257939840:12345-0@lo:104: Request processed in 43us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.724701:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789065722.724718:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789065722.724724:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724732:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030400 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065722.724736:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724744:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065722.724751:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065722.724764:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789065722.724796:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724803:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065722.724821:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724828:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040030400/0x7555615576c824a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824ad expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724853:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789065722.724856:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724862:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030e00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065722.724865:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724871:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065722.724878:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065722.724884:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789065722.724895:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724901:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065722.724923:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724929:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c8247c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82483 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724938:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065722.724941:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724947:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065722.724949:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724955:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065722.724960:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065722.724965:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789065722.724978:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724983:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065722.724988:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.724993:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040030a00/0x7555615576c82460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82467 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725002:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065722.725008:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065722.725010:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065722.725017:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065722.725038:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257940224:0@lo:103: 00000100:00100000:0.0:1789065722.725066:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.725105:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257940352:0@lo:103: 00000100:00100000:0.0:1789065722.725125:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.725142:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065722.725147:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257940480:0@lo:103: 00000100:00100000:0.0:1789065722.725165:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.725208:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940224 00000100:00100000:0.0:1789065722.725214:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940224 00010000:00010000:0.0:1789065722.725232:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c824a6 expref: 17 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065722.725245:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940352 00000100:00100000:0.0:1789065722.725247:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940352 00010000:00010000:0.0:1789065722.725256:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8247c expref: 18 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065722.725265:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940480 00000100:00100000:0.0:1789065722.725267:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940480 00010000:00010000:0.0:1789065722.725276:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82460 expref: 19 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065722.725286:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065722.725291:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257940224:12345-0@lo:103: 00010000:00010000:0.0:1789065722.725301:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065722.725305:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c824a6 expref: 19 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725321:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c824a6 expref: 19 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725336:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065722.725366:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257940224:12345-0@lo:103: Request processed in 75us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.725372:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065722.725385:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065722.725391:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3295:x1875971257940352:12345-0@lo:103: 00010000:00010000:0.0:1789065722.725398:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065722.725403:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8247c expref: 18 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725412:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8247c expref: 18 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725421:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065722.725445:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3295:x1875971257940352:12345-0@lo:103: Request processed in 55us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.725450:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065722.725461:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789065722.725467:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3295:x1875971257940480:12345-0@lo:103: 00010000:00010000:0.0:1789065722.725474:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065722.725477:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82460 expref: 17 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725485:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82460 expref: 17 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.725500:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065722.725520:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3295:x1875971257940480:12345-0@lo:103: Request processed in 54us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.725527:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789065722.725600:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257940224:0@lo:103: 00000100:00100000:0.0:1789065722.725623:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257940480:0@lo:103: 00000100:00100000:0.0:1789065722.725629:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257940352:0@lo:103: 00010000:00010000:1.0:1789065722.725707:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065722.725796:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fc800/0x7555615576c824ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c824a6 expref: 16 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.725807:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939584:0@lo:104: 00010000:00010000:2.0:1789065722.725817:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fd200/0x7555615576c82483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8247c expref: 15 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.725825:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058217100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939712:0@lo:104: 00010000:00010000:2.0:1789065722.725843:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073000/0x7555615576c82467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82460 expref: 14 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.725851:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058217480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939840:0@lo:104: 00000100:00100000:3.0:1789065722.726003:0:5822:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.726013:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257939968 00000100:00100000:3.0:1789065722.726016:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257939968 00000100:00100000:3.0:1789065722.726034:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940096 00000100:00100000:3.0:1789065722.726037:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940096 00000100:00100000:3.0:1789065722.726048:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789065722.726054:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:5831:x1875971257939968:12345-0@lo:104: 00010000:00010000:3.0:1789065722.726062:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726114:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789065722.726119:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:5831:x1875971257939968:12345-0@lo:104: Request processed in 67us (1825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.726125:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789065722.726137:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789065722.726142:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257940096:12345-0@lo:104: 00010000:00010000:3.0:1789065722.726157:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726189:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789065722.726193:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5831:x1875971257940096:12345-0@lo:104: Request processed in 52us (191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.726199:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789065722.726213:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789065722.726218:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726224:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffa00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065722.726227:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726235:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065722.726241:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065722.726246:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065722.726267:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726273:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065722.726286:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726293:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c82436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8243d expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726308:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065722.726311:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726317:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065722.726320:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726327:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065722.726334:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065722.726339:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065722.726353:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726358:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065722.726363:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726370:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c8240c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82413 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726383:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065722.726384:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065722.726386:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065722.726397:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257940608:0@lo:103: 00000100:00100000:3.0:1789065722.726430:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.726455:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065722.726460:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257940736:0@lo:103: 00000100:00100000:3.0:1789065722.726478:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.726504:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940608 00000100:00100000:3.0:1789065722.726508:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940608 00010000:00010000:3.0:1789065722.726521:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82436 expref: 14 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.726538:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940736 00000100:00100000:3.0:1789065722.726541:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940736 00010000:00010000:3.0:1789065722.726573:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8240c expref: 15 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.726585:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789065722.726590:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3297:x1875971257940608:12345-0@lo:103: 00010000:00010000:3.0:1789065722.726598:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065722.726601:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82436 expref: 15 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726611:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82436 expref: 15 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726622:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065722.726646:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3297:x1875971257940608:12345-0@lo:103: Request processed in 56us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.726653:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789065722.726664:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789065722.726669:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3297:x1875971257940736:12345-0@lo:103: 00010000:00010000:3.0:1789065722.726684:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065722.726689:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8240c expref: 14 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726698:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8240c expref: 14 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726709:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726717:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726729:0:5825:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726736:0:5825:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726743:0:5825:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726750:0:5825:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726755:0:5825:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fc200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065722.726759:0:5825:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726766:0:5825:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726785:0:5825:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.726794:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065722.726816:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3297:x1875971257940736:12345-0@lo:103: Request processed in 146us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.726822:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789065722.726871:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a748a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257940736:0@lo:103: 00000100:00100000:3.0:1789065722.726879:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257940608:0@lo:103: 00010000:00010000:3.0:1789065722.726892:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065722.726958:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030c00/0x7555615576c8243d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82436 expref: 13 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065722.726969:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257939968:0@lo:104: 00010000:00010000:1.0:1789065722.726979:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821fea00/0x7555615576c82413 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8240c expref: 12 pid: 5832 timeout: 331 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065722.726997:0:5831:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5831:1875971257940096:0@lo:104: 00010000:00010000:1.0:1789065722.727020:0:5831:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.727028:0:5831:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.727034:0:5831:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.727040:0:5831:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fc200/0x7555615576c824c2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789065722.727054:0:5831:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1789065722.778348:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:7619:x1875971257939456:12345-0@lo:253: Request processed in 63114us (63393us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.778363:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789065722.778472:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257939456:0@lo:253: 10000000:01000000:2.0:1789065722.778487:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789065722.778491:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789065722.778492:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789065722.778494:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789065722.778495:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789065722.778496:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789065722.778497:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789065722.778499:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789065722.778500:0:7619:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789065722.778502:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789065722.778503:0:7619:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789065722.778524:0:7619:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf081779000 from lustre-OST0001 10000000:01000000:2.0:1789065722.778571:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789065722.778575:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789065722.778582:0:7619:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf0581e4d40 local copy 10000000:01000000:2.0:1789065722.778587:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789065722.778625:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.778647:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.778658:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.778678:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257940864:0@lo:101: 00000100:00100000:2.0:1789065722.778727:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.778771:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.778938:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940864 00000100:00100000:1.0:1789065722.778946:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940864 00000100:00100000:1.0:1789065722.778991:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789065722.778999:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+11:7619:x1875971257940864:12345-0@lo:101: 00010000:00010000:1.0:1789065722.779011:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065722.779024:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072a00/0x7555615576c824d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c824c9 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.779048:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072a00/0x7555615576c824d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c824c9 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.779059:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072a00/0x7555615576c824d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824c9 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.779075:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072a00, rc 0) 00000100:00100000:1.0:1789065722.779117:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:7619:x1875971257940864:12345-0@lo:101: Request processed in 118us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.779123:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789065722.779469:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257940864:0@lo:101: 00010000:00010000:2.0:1789065722.779483:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.779493:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.779633:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257940992:0@lo:501: 00000100:00100000:2.0:1789065722.779665:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.779685:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.779760:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257940992 00000100:00100000:1.0:1789065722.779765:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257940992 00000100:00100000:1.0:1789065722.779795:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789065722.779812:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:7619:x1875971257940992:12345-0@lo:501: 00000100:00100000:1.0:1789065722.780042:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:7619:x1875971257940992:12345-0@lo:501: Request processed in 232us (375us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789065722.780050:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789065722.780183:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257940992:0@lo:501: 10000000:01000000:3.0:1789065722.780196:0:7619:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789065722.780224:0:7619:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789065722.780230:0:7619:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780238:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780245:0:7619:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780276:0:7619:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789065722.780295:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf081779000 10000000:01000000:3.0:1789065722.780299:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789065722.780304:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789065722.780313:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789065722.780318:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1789065722.780320:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1789065722.780338:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780346:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780354:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.780367:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941120:0@lo:101: 00000100:00100000:3.0:1789065722.780395:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.780412:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.780426:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941120 00000100:00100000:3.0:1789065722.780430:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941120 00000100:00100000:3.0:1789065722.780452:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789065722.780459:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:7619:x1875971257941120:12345-0@lo:101: 00010000:00010000:3.0:1789065722.780469:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065722.780480:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c824d7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780497:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c824d7 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780506:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824d7 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780513:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ffa00, rc 0) 00000100:00100000:3.0:1789065722.780571:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941120:12345-0@lo:101: Request processed in 113us (176us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.780577:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789065722.780608:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941120:0@lo:101: 00010000:00010000:3.0:1789065722.780618:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.780625:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.780677:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941248:0@lo:501: 00000100:00100000:3.0:1789065722.780700:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.780720:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.780731:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941248 00000100:00100000:3.0:1789065722.780734:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941248 00000100:00100000:3.0:1789065722.780750:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789065722.780756:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941248:12345-0@lo:501: 00000100:00100000:3.0:1789065722.780938:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941248:12345-0@lo:501: Request processed in 180us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.780945:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789065722.780975:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941248:0@lo:501: 00000100:00100000:3.0:1789065722.780999:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941376:0@lo:503: 00000100:00100000:3.0:1789065722.781037:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.781050:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.781062:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941376 00000100:00100000:3.0:1789065722.781065:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941376 00000100:00100000:3.0:1789065722.781083:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789065722.781095:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941376:12345-0@lo:503: 00000100:00100000:3.0:1789065722.781237:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941376:12345-0@lo:503: Request processed in 143us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.781244:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789065722.781279:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941376:0@lo:503: 00000040:00080000:3.0:1789065722.781592:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789065722.781649:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941504:0@lo:502: 00000100:00100000:3.0:1789065722.781682:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.781704:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.781717:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941504 00000100:00100000:3.0:1789065722.781720:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941504 00000100:00100000:3.0:1789065722.781738:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789065722.781743:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941504:12345-0@lo:502: 00000100:00100000:3.0:1789065722.781880:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941504:12345-0@lo:502: Request processed in 134us (196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.781886:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789065722.781920:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941504:0@lo:502: 00000040:00080000:3.0:1789065722.782136:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789065722.782182:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789065722.782217:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789065722.782288:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789065722.782329:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789065722.782359:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789065722.782381:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941632:0@lo:502: 00000100:00100000:3.0:1789065722.782420:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.782436:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.782530:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941632 00000100:00100000:3.0:1789065722.782541:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941632 00000100:00100000:3.0:1789065722.782587:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789065722.782593:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941632:12345-0@lo:502: 00000100:00100000:3.0:1789065722.782725:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941632:12345-0@lo:502: Request processed in 132us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.782733:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789065722.782776:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941632:0@lo:502: 00000040:00080000:3.0:1789065722.782879:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789065722.782889:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:1.0:1789065722.783078:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789065722.783089:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.783098:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fd200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:1.0:1789065722.783102:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.783110:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789065722.783117:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789065722.783122:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789065722.783145:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.783161:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789065722.783183:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.783190:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0413fd200/0x7555615576c824c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x7555615576c824d0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.783204:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065722.783206:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065722.783207:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065722.783218:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257941760:0@lo:103: 00000100:00100000:1.0:1789065722.783251:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065722.783297:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941760 00000100:00100000:1.0:1789065722.783301:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941760 00000100:00100000:1.0:1789065722.783335:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065722.783342:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3295:x1875971257941760:12345-0@lo:103: 00010000:00010000:1.0:1789065722.783353:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065722.783366:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072a00/0x7555615576c824d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c824c9 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.783378:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065722.783405:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3295:x1875971257941760:12345-0@lo:103: Request processed in 63us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.783410:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065722.783437:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257941760:0@lo:103: 00000020:01000000:3.0:1789065722.784421:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789065722.784435:0:7626:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789065722.784442:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065722.784445:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789065722.784453:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789065722.784470:0:7626:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cf074ea99c0) 00000020:00000080:3.0:1789065722.784495:0:7626:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789065722.784501:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789065722.784594:0:7626:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf081779000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789065722.784603:0:7626:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789065722.784611:0:7626:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7555615576c824ec 00010000:00010000:2.0:1789065722.788289:0:7626:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:2.0:1789065722.788817:0:7626:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789065722.792348:0:7626:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789065722.792701:0:7626:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789065722.797169:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789065722.797956:0:7626:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1789065722.799480:0:7626:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789065722.799493:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065722.799501:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065722.799503:0:7626:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1789065722.799510:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789065722.799514:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065722.799515:0:7626:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789065722.799519:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789065722.799521:0:7626:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789065722.799597:0:7626:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065722.799600:0:7626:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065722.799602:0:7626:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789065722.799606:0:7626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1789065722.799766:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1789065722.799790:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789065722.799913:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.799926:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065722.799934:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf081779000 from 1 10000000:01000000:3.0:1789065722.799937:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789065722.799980:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.799989:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.800001:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.800023:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941888:0@lo:101: 00000100:00100000:3.0:1789065722.800090:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.800135:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.800242:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257941888 00000100:00100000:1.0:1789065722.800249:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257941888 00000100:00100000:1.0:1789065722.800306:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789065722.800315:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:7619:x1875971257941888:12345-0@lo:101: 00010000:00010000:1.0:1789065722.800330:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065722.800342:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c824f3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.800365:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c824f3 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.800375:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824f3 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.800384:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072a00, rc 0) 00000100:00100000:1.0:1789065722.800420:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257941888:12345-0@lo:101: Request processed in 106us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.800427:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789065722.800514:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257941888:0@lo:101: 00010000:00010000:3.0:1789065722.800529:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.800538:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.800646:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942016:0@lo:501: 00000100:00100000:3.0:1789065722.800671:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.800925:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a948b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.805293:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942016 00000100:00100000:1.0:1789065722.805317:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942016 00000100:00100000:1.0:1789065722.805384:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789065722.805395:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942016:12345-0@lo:501: 00000100:00100000:1.0:1789065722.805781:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942016:12345-0@lo:501: Request processed in 385us (5105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.805789:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1789065722.807581:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942016:0@lo:501: 00000100:00100000:1.0:1789065722.807649:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942144:0@lo:503: 00000100:00100000:1.0:1789065722.807729:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.807902:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942144 00000100:00100000:2.0:1789065722.807910:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942144 00000100:00100000:2.0:1789065722.807959:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789065722.807969:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942144:12345-0@lo:503: 00000100:00100000:2.0:1789065722.809517:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942144:12345-0@lo:503: Request processed in 1542us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.809531:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1789065722.814617:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b198480 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.814774:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942144:0@lo:503: 00000040:00080000:1.0:1789065722.815175:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789065722.815262:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942272:0@lo:502: 00000100:00100000:1.0:1789065722.815340:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065722.815377:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b198480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.815542:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942272 00000100:00100000:3.0:1789065722.815582:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942272 00000100:00100000:3.0:1789065722.815627:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789065722.815645:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942272:12345-0@lo:502: 00000100:00100000:3.0:1789065722.815888:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942272:12345-0@lo:502: Request processed in 244us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.815896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789065722.816107:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942272:0@lo:502: 00000040:00080000:0.0:1789065722.816373:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789065722.816422:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789065722.816452:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942400:0@lo:502: 00000100:00100000:0.0:1789065722.816494:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.816525:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051a65600 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.816622:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942400 00000100:00100000:1.0:1789065722.816685:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942400 00000100:00100000:1.0:1789065722.816758:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789065722.816767:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942400:12345-0@lo:502: 00000100:00100000:1.0:1789065722.816956:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942400:12345-0@lo:502: Request processed in 190us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.816963:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789065722.817979:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942400:0@lo:502: 00000040:00080000:0.0:1789065722.818144:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:0.0:1789065722.818158:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789065722.818777:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789065722.818788:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065722.818790:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789065722.818811:0:7630:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf081779000 00000020:00000080:0.0:1789065722.818813:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789065722.818846:0:7630:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065722.818850:0:7630:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065722.818851:0:7630:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789065722.818855:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1789065722.819173:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789065722.819196:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789065722.819217:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819228:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065722.819269:0:7619:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789065722.819272:0:7619:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf081779000 10000000:01000000:2.0:1789065722.819275:0:7619:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf081779000 10000000:01000000:2.0:1789065722.819278:0:7619:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789065722.819283:0:7619:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf081779000 from 1 10000000:01000000:2.0:1789065722.819286:0:7619:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789065722.819317:0:7619:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819325:0:7619:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819336:0:7619:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.819355:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942528:0@lo:101: 00000100:00100000:2.0:1789065722.819428:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.819478:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065722.819499:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942528 00000100:00100000:2.0:1789065722.819505:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942528 00000100:00100000:2.0:1789065722.819538:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789065722.819578:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257942528:12345-0@lo:101: 00010000:00010000:2.0:1789065722.819592:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065722.819607:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82501 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819642:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82501 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819653:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82501 expref: 14 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819662:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0413fc600, rc 0) 00000100:00100000:2.0:1789065722.819704:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942528:12345-0@lo:101: Request processed in 157us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.819710:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789065722.819768:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942528:0@lo:101: 00010000:00010000:2.0:1789065722.819781:0:7619:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.819791:0:7619:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065722.819991:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942656:0@lo:501: 00000100:00100000:2.0:1789065722.820016:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.820036:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065722.820057:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942656 00000100:00100000:2.0:1789065722.820061:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942656 00000100:00100000:2.0:1789065722.820077:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789065722.820083:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942656:12345-0@lo:501: 00000100:00100000:2.0:1789065722.820293:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942656:12345-0@lo:501: Request processed in 209us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.820300:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789065722.820329:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942656:0@lo:501: 00000100:00100000:2.0:1789065722.820357:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942784:0@lo:503: 00000100:00100000:2.0:1789065722.820395:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.820409:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065722.820421:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942784 00000100:00100000:2.0:1789065722.820425:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942784 00000100:00100000:2.0:1789065722.820442:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789065722.820447:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942784:12345-0@lo:503: 00000100:00100000:2.0:1789065722.820608:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942784:12345-0@lo:503: Request processed in 160us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.820614:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789065722.820648:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942784:0@lo:503: 00000040:00080000:2.0:1789065722.821260:0:7619:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789065722.821328:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942912:0@lo:502: 00000100:00100000:2.0:1789065722.821371:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.821399:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065722.821416:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257942912 00000100:00100000:2.0:1789065722.821421:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257942912 00000100:00100000:2.0:1789065722.821441:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789065722.821447:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942912:12345-0@lo:502: 00000100:00100000:2.0:1789065722.823136:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257942912:12345-0@lo:502: Request processed in 1681us (1757us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.823148:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789065722.823296:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257942912:0@lo:502: 00000040:00080000:0.0:1789065722.824039:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1789065722.824113:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1789065722.824147:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1789065722.824196:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1789065722.824233:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1789065722.824283:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1789065722.824318:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1789065722.824349:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1789065722.824411:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1789065722.824452:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1789065722.824488:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1789065722.824969:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1789065722.825014:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1789065722.825045:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1789065722.825092:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1789065722.825128:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1789065722.825163:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1789065722.825227:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1789065722.825263:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1789065722.825301:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1789065722.825360:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1789065722.825399:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1789065722.825433:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1789065722.825481:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1789065722.825519:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1789065722.825576:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1789065722.825736:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1789065722.825907:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1789065722.825941:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1789065722.825988:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1789065722.826024:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1789065722.826060:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1789065722.826092:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1789065722.826136:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1789065722.826169:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1789065722.826209:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1789065722.826238:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1789065722.826288:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257943040:0@lo:502: 00000100:00100000:0.0:1789065722.826370:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.826478:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051a65f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065722.826528:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943040 00000100:00100000:1.0:1789065722.826536:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943040 00000100:00100000:0.0:1789065722.827111:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789065722.827124:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257943040:12345-0@lo:502: 00000100:00100000:0.0:1789065722.827392:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257943040:12345-0@lo:502: Request processed in 270us (1021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.827400:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789065722.827499:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257943040:0@lo:502: 00000040:00080000:1.0:1789065722.827613:0:7619:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789065722.827627:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1789065722.836720:0:7631:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789065722.836920:0:7631:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cf081664d40) 00000020:00000080:2.0:1789065722.836943:0:7631:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1789065722.837009:0:7631:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf081779000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789065722.837014:0:7631:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf081779000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789065722.837016:0:7631:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf081779000 3 00010000:00080000:2.0:1789065722.837045:0:7631:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf08164c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065722.839257:0:7631:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:2.0:1789065722.841960:0:7631:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789065722.842001:0:7631:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789065722.842015:0:7631:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7555615576c82516 00000100:00080000:2.0:1789065722.842026:0:7631:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789065722.842039:0:7631:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cf08164c800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065722.842073:0:7631:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf058214000 x1875971257943168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789065722.842104:0:7631:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789065722.842196:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3294:1875971257943168:0@lo:38: 00000100:00100000:3.0:1789065722.842258:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.842583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943168 00000100:00100000:2.0:1789065722.842591:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943168 00000100:00100000:2.0:1789065722.842619:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065722.842626:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3294:x1875971257943168:12345-0@lo:38: 00010000:00080000:2.0:1789065722.842668:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 182 last 0 00000020:00000080:2.0:1789065722.842710:0:5839:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7555615576c8251d 00000004:00100000:2.0:1789065722.842726:0:5839:0:(mdt_handler.c:7356:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000040:00080000:3.0:1789065722.843013:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:2.0:1789065722.843126:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9cf07b234000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789065722.843192:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875971257943168:12345-0@lo:38: Request processed in 566us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.843200:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1789065722.843254:0:7633:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff9cf058215180 x1875971257943296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065722.843264:0:7633:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437ce600 going to sleep for 0 seconds 00010000:00080000:3.0:1789065722.843316:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf058214000 x1875971257943168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789065732 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065722.843325:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789065722.843331:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789065722.843337:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789065722.843342:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789065722.843344:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf08164c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789065722.843349:0:3294:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b7b2475b): req@ffff9cf058215180 x1875971257943296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065722.843370:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3294:1875971257943168:0@lo:38: 00000100:00100000:2.0:1789065722.843619:0:7633:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.843648:0:7633:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437ce600 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.843703:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943296 00000100:00100000:3.0:1789065722.843708:0:5849:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943296 00000100:00100000:3.0:1789065722.843765:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789065722.843774:0:5849:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1875971257943296:12345-0@lo:901: 00000100:00100000:3.0:1789065722.844140:0:5849:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7633:x1875971257943296:12345-0@lo:901: Request processed in 367us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.844148:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789065722.847108:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789065722.847171:0:7633:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf058215180 x1875971257943296/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789065738 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065722.847188:0:7633:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7633:1875971257943296:0@lo:901: 00000100:00100000:1.0:1789065722.847592:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257943552:0@lo:400: 00000100:00100000:1.0:1789065722.847665:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065722.847698:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789065722.847703:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257943680:0@lo:400: 00000100:00100000:1.0:1789065722.847730:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065722.847778:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943552 00000100:00100000:1.0:1789065722.847784:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943552 00000100:00100000:1.0:1789065722.847842:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789065722.847852:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257943552:12345-0@lo:400: 00000100:00100000:1.0:1789065722.847902:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257943552:12345-0@lo:400: Request processed in 51us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065722.847926:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789065722.847958:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae65180 x1875971257943552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065722.847967:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257943552:0@lo:400: 00000020:01000000:1.0:1789065722.847987:0:7619:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1789065722.848014:0:7619:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789065722.848029:0:7619:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065722.848039:0:7619:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789065722.848087:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789065722.848089:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789065722.848091:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789065722.848092:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789065722.848093:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789065722.848094:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789065722.848095:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789065722.848097:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789065722.848099:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789065722.848100:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789065722.848102:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789065722.848105:0:7619:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1789065722.848108:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789065722.848109:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789065722.848110:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789065722.848111:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789065722.848112:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789065722.848113:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789065722.848114:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789065722.848115:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789065722.848116:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789065722.848122:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789065722.848123:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789065722.848139:0:7619:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789065722.848149:0:7619:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257943808:0@lo:253: 00000100:00100000:1.0:1789065722.848179:0:7619:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065722.848199:0:7619:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b198480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065722.848390:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943808 00000100:00100000:3.0:1789065722.848395:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943808 00000100:00100000:3.0:1789065722.848423:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789065722.848430:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:7619:x1875971257943808:12345-0@lo:253: 20000000:01000000:3.0:1789065722.848466:0:5832:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:3.0:1789065722.848482:0:5832:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1789065722.848927:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065722.848945:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257943424:0@lo:400: 00000100:00100000:3.0:1789065722.848982:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065722.849136:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943424 00000100:00100000:2.0:1789065722.849142:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943424 00000100:00100000:2.0:1789065722.849172:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789065722.849178:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257943424:12345-0@lo:400: 00000100:00100000:2.0:1789065722.849224:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257943424:12345-0@lo:400: Request processed in 46us (240us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.849230:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1789065722.849271:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae67b80 x1875971257943424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065722.849282:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257943424:0@lo:400: 00000100:00100000:0.0:1789065722.852923:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943680 00000100:00100000:0.0:1789065722.852940:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943680 00000100:00100000:0.0:1789065722.853003:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065722.853015:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257943680:12345-0@lo:400: 00000100:00100000:0.0:1789065722.853128:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257943680:12345-0@lo:400: Request processed in 117us (5397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.853137:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789065722.853204:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07ae64a80 x1875971257943680/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065738 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065722.853221:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257943680:0@lo:400: 00010000:00010000:3.0:1789065722.855302:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:3.0:1789065722.919594:0:5832:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789065722.919616:0:5832:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789065722.919732:0:5854:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789065722.919738:0:5854:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789065722.919762:0:5854:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.919781:0:5854:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8246e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.919790:0:5854:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.919855:0:5854:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8246e expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065722.919869:0:5854:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8246e expref: 14 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065722.919883:0:5854:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818da680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875971257943936:0@lo:104: 00000100:00100000:0.0:1789065722.919946:0:5854:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065722.920006:0:5854:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051a65540 going to sleep for 11 seconds 00000100:00100000:2.0:1789065722.920208:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257943936 00000100:00100000:2.0:1789065722.920216:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257943936 00000100:00100000:2.0:1789065722.920265:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789065722.920275:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5854:x1875971257943936:12345-0@lo:104: 00010000:00010000:2.0:1789065722.920289:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065722.920353:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789065722.920359:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:5854:x1875971257943936:12345-0@lo:104: Request processed in 87us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065722.920366:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789065722.920445:0:5854:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818da680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5854:1875971257943936:0@lo:104: 00010000:00010000:0.0:1789065722.920477:0:5854:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921320:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065722.921330:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921339:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065722.921343:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921352:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065722.921360:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065722.921366:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065722.921405:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921411:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065722.921431:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921438:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c8246e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82475 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921467:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065722.921476:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065722.921478:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065722.921492:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257944064:0@lo:103: 00000100:00100000:3.0:1789065722.921538:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065722.921622:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944064 00000100:00100000:3.0:1789065722.921627:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944064 00010000:00010000:3.0:1789065722.921662:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8246e expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065722.921684:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789065722.921691:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3295:x1875971257944064:12345-0@lo:103: 00010000:00010000:3.0:1789065722.921713:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065722.921718:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8246e expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921728:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8246e expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921740:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fd000/0x7555615576c82475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8246e expref: 15 pid: 5832 timeout: 332 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921756:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921764:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789065722.921778:0:5824:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006219330s 00010000:00010000:3.0:1789065722.921782:0:5824:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921960:0:5824:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921967:0:5824:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921974:0:5824:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921979:0:5824:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065722.921983:0:5824:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.921990:0:5824:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.922005:0:5824:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.922013:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065722.922045:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e09050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3295:x1875971257944064:12345-0@lo:103: Request processed in 354us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065722.922051:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789065722.922104:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257944064:0@lo:103: 00010000:00010000:3.0:1789065722.922121:0:5854:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.922129:0:5854:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065722.922148:0:5854:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030a00/0x7555615576c82524 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5854 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065722.961666:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:7619:x1875971257943808:12345-0@lo:253: Request processed in 113225us (113476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065722.961681:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789065722.961884:0:7619:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:8c7529dd-e8b4-44e5-b83f-e77028f31a41:7619:1875971257943808:0@lo:253: 10000000:01000000:1.0:1789065722.961900:0:7619:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789065722.961903:0:7619:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789065722.961905:0:7619:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789065722.961906:0:7619:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789065722.961908:0:7619:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789065722.961909:0:7619:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789065722.961910:0:7619:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789065722.961912:0:7619:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789065722.961914:0:7619:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789065722.961915:0:7619:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789065722.961917:0:7619:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789065722.961918:0:7619:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789065722.961932:0:7619:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789065722.971116:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065722.972661:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789065722.974415:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065722.976144:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789065722.976435:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065722.980060:0:7619:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789065722.983157:0:7619:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:2.0:1789065723.281782:0:7619:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789065723.281860:0:7619:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1789065723.281971:0:7619:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789065723.282032:0:7619:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789065723.282051:0:7619:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1789065723.282084:0:7619:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1789065723.887262:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065724.902746:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065725.939039:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065726.117806:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065726.117836:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257944192:0@lo:13: 00000100:00100000:1.0:1789065726.117906:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065726.118036:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944192 00000100:00100000:2.0:1789065726.118045:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944192 00000100:00080000:1.0:1789065726.118204:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065726.118366:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789065726.118378:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257944192:12345-0@lo:13: 00002000:00000024:2.0:1789065726.118415:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065726.118479:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257944192:12345-0@lo:13: Request processed in 103us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065726.118486:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789065726.118574:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058215180 x1875971257944192/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065742 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065726.118592:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257944192:0@lo:13: 00010000:00010000:2.0:1789065726.950068:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065727.982267:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065728.183669:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257944320:0@lo:400: 00000100:00100000:1.0:1789065728.183799:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257944448:0@lo:400: 00000100:00100000:1.0:1789065728.183862:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065728.183932:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257944576:0@lo:400: 00000100:00100000:1.0:1789065728.183956:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065728.184003:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065728.184009:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257944704:0@lo:400: 00000100:00100000:1.0:1789065728.184034:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065728.184067:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944448 00000100:00100000:1.0:1789065728.184075:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944448 00000100:00100000:1.0:1789065728.184115:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944576 00000100:00100000:1.0:1789065728.184118:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944576 00000100:00100000:1.0:1789065728.184145:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789065728.184154:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257944448:12345-0@lo:400: 00000100:00100000:1.0:1789065728.184207:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257944448:12345-0@lo:400: Request processed in 53us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065728.184214:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789065728.184231:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789065728.184237:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257944576:12345-0@lo:400: 00000100:00100000:1.0:1789065728.184266:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257944576:12345-0@lo:400: Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065728.184272:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789065728.184289:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944704 00000100:00100000:1.0:1789065728.184293:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944704 00000100:00100000:1.0:1789065728.184320:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789065728.184326:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257944704:12345-0@lo:400: 00000100:00100000:1.0:1789065728.184356:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257944704:12345-0@lo:400: Request processed in 30us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065728.184361:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1789065728.184379:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789065728.184383:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789065728.184408:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058214000 x1875971257944448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065728.184436:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257944448:0@lo:400: 00010000:00080000:1.0:1789065728.184463:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058214380 x1875971257944704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065728.184471:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257944704:0@lo:400: 00010000:00080000:1.0:1789065728.184479:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058215880 x1875971257944576/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065728.184487:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257944576:0@lo:400: 00000100:00100000:0.0:1789065728.184776:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065728.184806:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257944832:0@lo:400: 00000100:00100000:0.0:1789065728.184835:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065728.184873:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944320 00000100:00100000:0.0:1789065728.184877:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944320 00000100:00100000:0.0:1789065728.184905:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789065728.184911:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3297:x1875971257944320:12345-0@lo:400: 00000100:00100000:0.0:1789065728.184949:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:3297:x1875971257944320:12345-0@lo:400: Request processed in 37us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065728.184955:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789065728.184979:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944832 00000100:00100000:0.0:1789065728.184982:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944832 00000100:00100000:0.0:1789065728.185008:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789065728.185014:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257944832:12345-0@lo:400: 00000100:00100000:0.0:1789065728.185041:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257944832:12345-0@lo:400: Request processed in 27us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065728.185046:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789065728.185073:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257944320:0@lo:400: 00010000:00080000:0.0:1789065728.185083:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058215c00 x1875971257944832/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065744 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065728.185091:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257944832:0@lo:400: 00000100:00080000:0.0:1789065728.185113:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789065729.004217:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065730.021719:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065730.550041:0:7976:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789065731.045688:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065731.238018:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065731.238057:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257944960:0@lo:13: 00000100:00100000:0.0:1789065731.238156:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065731.238245:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257944960 00000100:00100000:0.0:1789065731.238255:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257944960 00000100:00100000:0.0:1789065731.238329:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789065731.238340:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257944960:12345-0@lo:13: 00002000:00000024:0.0:1789065731.238387:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065731.238443:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257944960:12345-0@lo:13: Request processed in 104us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065731.238450:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1789065731.238477:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065731.238518:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf0818db800 x1875971257944960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065747 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065731.238538:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257944960:0@lo:13: 00010000:00010000:3.0:1789065732.069746:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789065732.266543:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789065732.266755:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf07a795800 from 30 10000000:01000000:0.0:1789065732.266761:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789065732.266807:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.266820:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.266830:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065732.266869:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945088:0@lo:101: 00000100:00100000:0.0:1789065732.266937:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.267040:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf061aa5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.271597:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945088 00000100:00100000:3.0:1789065732.271615:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945088 00000100:00100000:3.0:1789065732.271823:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789065732.271835:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257945088:12345-0@lo:101: 00010000:00010000:3.0:1789065732.271854:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065732.271874:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8252b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.271904:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8252b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.271916:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8252b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.271925:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ffc00, rc 0) 00000100:00100000:3.0:1789065732.272007:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257945088:12345-0@lo:101: Request processed in 174us (5070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.272013:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789065732.272067:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945088:0@lo:101: 00010000:00010000:3.0:1789065732.272086:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.272095:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.272165:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945216:0@lo:501: 00000100:00100000:3.0:1789065732.272199:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.272229:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.272243:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945216 00000100:00100000:3.0:1789065732.272246:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945216 00000100:00100000:3.0:1789065732.272265:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789065732.272271:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257945216:12345-0@lo:501: 00000100:00100000:3.0:1789065732.273211:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257945216:12345-0@lo:501: Request processed in 935us (1007us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.273221:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789065732.273772:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945216:0@lo:501: 00000100:00100000:0.0:1789065732.273813:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945344:0@lo:503: 00000100:00100000:0.0:1789065732.273858:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.273881:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf061aa5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.273928:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945344 00000100:00100000:3.0:1789065732.273934:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945344 00000100:00100000:3.0:1789065732.273968:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789065732.273975:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257945344:12345-0@lo:503: 00000100:00100000:3.0:1789065732.274884:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257945344:12345-0@lo:503: Request processed in 903us (1020us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.274894:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789065732.283182:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945344:0@lo:503: 00000100:00100000:3.0:1789065732.288833:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8063:1875971257945472:0@lo:502: 00000100:00100000:3.0:1789065732.288906:0:8063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.288946:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945472 00000100:00100000:3.0:1789065732.288952:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945472 00000100:00100000:3.0:1789065732.288986:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789065732.288993:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8063:x1875971257945472:12345-0@lo:502: 00000100:00100000:3.0:1789065732.289220:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8063:x1875971257945472:12345-0@lo:502: Request processed in 225us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.289227:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1789065732.289276:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77180 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.289295:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8063:1875971257945472:0@lo:502: 00000100:00100000:3.0:1789065732.289342:0:8063:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8063:1875971257945600:0@lo:502: 00000100:00100000:3.0:1789065732.289373:0:8063:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.289387:0:8063:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77180 going to sleep for 11 seconds 00000100:00100000:0.0:1789065732.289812:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945600 00000100:00100000:0.0:1789065732.289818:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945600 00000100:00100000:0.0:1789065732.289853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789065732.289859:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8063:x1875971257945600:12345-0@lo:502: 00000100:00100000:0.0:1789065732.289995:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8063:x1875971257945600:12345-0@lo:502: Request processed in 135us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065732.290002:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789065732.291367:0:8063:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74a300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8063:1875971257945600:0@lo:502: 00000040:00080000:3.0:1789065732.291413:0:8063:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1789065732.291815:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1789065732.291842:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789065732.291854:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.291867:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065732.291877:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789065732.291880:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:0.0:1789065732.291882:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789065732.291922:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.291937:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.291948:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065732.291968:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945728:0@lo:101: 00000100:00100000:0.0:1789065732.292027:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.292576:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.293493:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945728 00000100:00100000:3.0:1789065732.293503:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945728 00000100:00100000:3.0:1789065732.293632:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789065732.293643:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257945728:12345-0@lo:101: 00010000:00010000:3.0:1789065732.293673:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065732.293692:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82539 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.293720:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82539 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.293816:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82539 expref: 15 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.293825:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fe800, rc 0) 00000100:00100000:3.0:1789065732.293900:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257945728:12345-0@lo:101: Request processed in 259us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.293907:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789065732.293984:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945728:0@lo:101: 00010000:00010000:0.0:1789065732.294001:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.294010:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065732.294075:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945856:0@lo:501: 00000100:00100000:0.0:1789065732.294107:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.294143:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.294193:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945856 00000100:00100000:3.0:1789065732.294197:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945856 00000100:00100000:3.0:1789065732.294256:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789065732.294264:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257945856:12345-0@lo:501: 00000100:00100000:3.0:1789065732.294520:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257945856:12345-0@lo:501: Request processed in 256us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.294527:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1789065732.295005:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945856:0@lo:501: 00000100:00100000:0.0:1789065732.295036:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945984:0@lo:503: 00000100:00100000:0.0:1789065732.295075:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.295139:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.295201:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257945984 00000100:00100000:3.0:1789065732.295206:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257945984 00000100:00100000:3.0:1789065732.295231:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789065732.295238:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257945984:12345-0@lo:503: 00000100:00100000:3.0:1789065732.295453:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257945984:12345-0@lo:503: Request processed in 203us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.295460:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789065732.295606:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257945984:0@lo:503: 00000100:00100000:0.0:1789065732.296129:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8065:1875971257946112:0@lo:502: 00000100:00100000:0.0:1789065732.296176:0:8065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.296236:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.296266:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946112 00000100:00100000:3.0:1789065732.296270:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946112 00000100:00100000:3.0:1789065732.296326:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789065732.296334:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8065:x1875971257946112:12345-0@lo:502: 00000100:00100000:3.0:1789065732.296531:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8065:x1875971257946112:12345-0@lo:502: Request processed in 197us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.296543:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789065732.297100:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8065:1875971257946112:0@lo:502: 00000020:01000000:2.0:1789065732.297128:0:8065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789065732.297138:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065732.297141:0:8065:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789065732.297150:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789065732.297157:0:8065:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789065732.297178:0:8065:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8065:1875971257946240:0@lo:502: 00000100:00100000:2.0:1789065732.297217:0:8065:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.297349:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946240 00000100:00100000:0.0:1789065732.297355:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946240 00000100:00100000:0.0:1789065732.297379:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789065732.297387:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8065:x1875971257946240:12345-0@lo:502: 00000100:00100000:0.0:1789065732.297541:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8065:x1875971257946240:12345-0@lo:502: Request processed in 154us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065732.297753:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789065732.297870:0:8065:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437cea80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065732.297887:0:8065:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8065:1875971257946240:0@lo:502: 00000020:01000000:2.0:1789065732.297907:0:8065:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065732.297912:0:8065:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065732.297914:0:8065:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789065732.297919:0:8065:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789065732.298090:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789065732.298108:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789065732.298118:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.298129:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065732.298139:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789065732.298142:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf04c2a4800 from 30 10000000:01000000:3.0:1789065732.298145:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789065732.298174:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.298182:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.298191:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.298205:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257946368:0@lo:101: 00000100:00100000:3.0:1789065732.298238:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.298291:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77300 going to sleep for 11 seconds 00000100:00100000:0.0:1789065732.298325:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946368 00000100:00100000:0.0:1789065732.298331:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946368 00000100:00100000:0.0:1789065732.298391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1789065732.298398:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257946368:12345-0@lo:101: 00010000:00010000:0.0:1789065732.298407:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065732.298419:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82547 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.298452:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82547 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.298463:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82547 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065732.298472:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031800, rc 0) 00000100:00100000:0.0:1789065732.298583:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257946368:12345-0@lo:101: Request processed in 185us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065732.298590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1789065732.298858:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257946368:0@lo:101: 00010000:00010000:2.0:1789065732.298875:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065732.298884:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065732.298938:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257946496:0@lo:501: 00000100:00100000:2.0:1789065732.298968:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065732.299001:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437cea80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.299044:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946496 00000100:00100000:3.0:1789065732.299048:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946496 00000100:00100000:3.0:1789065732.299081:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789065732.299088:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257946496:12345-0@lo:501: 00000100:00100000:3.0:1789065732.299312:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257946496:12345-0@lo:501: Request processed in 224us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.299325:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789065732.299360:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257946496:0@lo:501: 00000100:00100000:3.0:1789065732.299388:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257946624:0@lo:503: 00000100:00100000:3.0:1789065732.299423:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.299453:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946624 00000100:00100000:3.0:1789065732.299457:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946624 00000100:00100000:3.0:1789065732.299476:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789065732.299481:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257946624:12345-0@lo:503: 00000100:00100000:3.0:1789065732.299817:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257946624:12345-0@lo:503: Request processed in 334us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.299824:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789065732.299856:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.299869:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257946624:0@lo:503: 00000100:00100000:3.0:1789065732.300017:0:8066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8066:1875971257946752:0@lo:502: 00000100:00100000:3.0:1789065732.300050:0:8066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.300068:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946752 00000100:00100000:3.0:1789065732.300071:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946752 00000100:00100000:3.0:1789065732.300089:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789065732.300095:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8066:x1875971257946752:12345-0@lo:502: 00000100:00100000:3.0:1789065732.300235:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8066:x1875971257946752:12345-0@lo:502: Request processed in 139us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.300242:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789065732.300271:0:8066:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77300 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.300284:0:8066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8066:1875971257946752:0@lo:502: 00000100:00100000:3.0:1789065732.300328:0:8066:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8066:1875971257946880:0@lo:502: 00000100:00100000:3.0:1789065732.300358:0:8066:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.300377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257946880 00000100:00100000:3.0:1789065732.300380:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257946880 00000100:00100000:3.0:1789065732.300398:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789065732.300403:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8066:x1875971257946880:12345-0@lo:502: 00000100:00100000:1.0:1789065732.300719:0:8066:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c399c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.300910:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8066:x1875971257946880:12345-0@lo:502: Request processed in 506us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.300917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1789065732.300972:0:8066:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8066:1875971257946880:0@lo:502: 00000040:00080000:1.0:1789065732.300994:0:8066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1789065732.301140:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1789065732.301158:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789065732.301167:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.301176:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065732.301184:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789065732.301187:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf04c2a4800 from 5 10000000:01000000:3.0:1789065732.301189:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789065732.301215:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.301222:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.301232:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.301257:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947008:0@lo:101: 00000100:00100000:3.0:1789065732.301284:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.301345:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77300 going to sleep for 11 seconds 00000100:00100000:1.0:1789065732.301378:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947008 00000100:00100000:1.0:1789065732.301383:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947008 00000100:00100000:1.0:1789065732.301458:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789065732.301466:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257947008:12345-0@lo:101: 00010000:00010000:1.0:1789065732.301474:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065732.301487:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073000/0x7555615576c8255c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82555 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065732.301505:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073000/0x7555615576c8255c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82555 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065732.301515:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073000/0x7555615576c8255c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82555 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065732.301531:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073000, rc 0) 00000100:00100000:1.0:1789065732.301602:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257947008:12345-0@lo:101: Request processed in 136us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065732.301608:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1789065732.301776:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947008:0@lo:101: 00010000:00010000:3.0:1789065732.301788:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.301797:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.301840:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947136:0@lo:256: 00000100:00100000:3.0:1789065732.301867:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.302033:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77300 going to sleep for 11 seconds 00000100:00100000:1.0:1789065732.302079:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947136 00000100:00100000:1.0:1789065732.302083:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947136 00000100:00100000:1.0:1789065732.302099:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1789065732.302105:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257947136:12345-0@lo:256: 20000000:01000000:1.0:1789065732.302116:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789065732.302132:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789065732.302135:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1789065732.302208:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257947136:12345-0@lo:256: Request processed in 103us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065732.302215:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789065732.302300:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947136:0@lo:256: 10000000:01000000:3.0:1789065732.302342:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789065732.302348:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.302356:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065732.302363:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789065732.302365:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1789065732.302368:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789065732.302384:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.302401:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.302410:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.302422:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947264:0@lo:101: 00000100:00100000:3.0:1789065732.302511:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.302755:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca0e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065732.302824:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947264 00000100:00100000:1.0:1789065732.302828:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947264 00000100:00100000:1.0:1789065732.302893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789065732.302900:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257947264:12345-0@lo:101: 00010000:00010000:1.0:1789065732.302908:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065732.302918:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82563 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065732.302935:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82563 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065732.302945:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82563 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065732.302962:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073600, rc 0) 00000100:00100000:1.0:1789065732.302999:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257947264:12345-0@lo:101: Request processed in 99us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065732.303005:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789065732.303059:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947264:0@lo:101: 00010000:00010000:3.0:1789065732.303070:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.303077:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.303119:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947392:0@lo:501: 00000100:00100000:3.0:1789065732.303143:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.303210:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065732.303236:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947392 00000100:00100000:2.0:1789065732.303240:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947392 00000100:00100000:2.0:1789065732.303261:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789065732.303268:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257947392:12345-0@lo:501: 00000100:00100000:2.0:1789065732.303598:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257947392:12345-0@lo:501: Request processed in 330us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065732.303605:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1789065732.303847:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947392:0@lo:501: 00000100:00100000:3.0:1789065732.303874:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947520:0@lo:503: 00000100:00100000:3.0:1789065732.303911:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.303968:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065732.303998:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947520 00000100:00100000:2.0:1789065732.304002:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947520 00000100:00100000:2.0:1789065732.304066:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789065732.304073:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257947520:12345-0@lo:503: 00000100:00100000:2.0:1789065732.304294:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257947520:12345-0@lo:503: Request processed in 221us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065732.304301:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1789065732.304359:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257947520:0@lo:503: 00000100:00100000:3.0:1789065732.304603:0:8068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8068:1875971257947648:0@lo:502: 00000100:00100000:3.0:1789065732.304662:0:8068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065732.304999:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947648 00000100:00100000:1.0:1789065732.305004:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947648 00000100:00100000:1.0:1789065732.305027:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789065732.305033:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8068:x1875971257947648:12345-0@lo:502: 00000100:00100000:1.0:1789065732.305256:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8068:x1875971257947648:12345-0@lo:502: Request processed in 222us (593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065732.305263:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789065732.305369:0:8068:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050ca0e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.305384:0:8068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8068:1875971257947648:0@lo:502: 00000020:01000000:3.0:1789065732.305409:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789065732.305417:0:8068:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1789065732.305422:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065732.305425:0:8068:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789065732.305429:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789065732.305434:0:8068:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:3.0:1789065732.305979:0:8068:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789065732.305983:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789065732.305998:0:8068:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cf074ea8000) 00000020:00000080:3.0:1789065732.306019:0:8068:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1789065732.306025:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789065732.306100:0:8068:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789065732.306106:0:8068:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:3.0:1789065732.306114:0:8068:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c82578 00010000:00080000:3.0:1789065732.306143:0:8068:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf08164f800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1789065732.306377:0:8068:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1789065732.307486:0:8068:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1789065732.307501:0:8068:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1789065732.308492:0:8068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789065732.308903:0:8068:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789065732.308956:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1789065732.309014:0:8068:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1789065732.310281:0:8070:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065732.310287:0:8070:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789065732.311245:0:8068:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065732.311258:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789065732.311291:0:8068:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789065732.311319:0:8068:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c8257f 00000100:00080000:3.0:1789065732.311330:0:8068:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789065732.311344:0:8068:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf08164f800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789065732.311382:0:8068:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07a749f80 x1875971257947776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789065732.311518:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971257947776:0@lo:8: 00000100:00100000:2.0:1789065732.311752:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065732.311852:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947776 00000100:00100000:1.0:1789065732.311860:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947776 00000100:00100000:1.0:1789065732.311899:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789065732.311953:0:8068:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:0.0:1789065732.312003:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789065732.312015:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257948032:0@lo:400: 00000020:01000000:3.0:1789065732.312060:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065732.312065:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065732.312067:0:8068:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789065732.312070:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789065732.312074:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065732.312075:0:8068:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789065732.312079:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789065732.312080:0:8068:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789065732.312102:0:8068:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8068:1875971257948416:0@lo:502: 00000100:00100000:0.0:1789065732.312123:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.312147:0:8068:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.312156:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257947904:0@lo:400: 00000100:00100000:3.0:1789065732.312167:0:8068:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050eb03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065732.312232:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3294:x1875971257947776:12345-0@lo:8: 00010000:00080000:1.0:1789065732.312257:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 191 last 0 00000020:00000080:1.0:1789065732.312285:0:6687:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c82586 00002000:00100000:1.0:1789065732.312298:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cf081893800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789065732.312302:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000100:00100000:0.0:1789065732.312302:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00000004:1.0:1789065732.312305:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:0.0:1789065732.312413:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257948160:0@lo:400: 00002000:00100000:1.0:1789065732.312421:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:0.0:1789065732.312437:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.312466:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065732.312472:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257948288:0@lo:400: 00000100:00100000:0.0:1789065732.312493:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.312532:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948160 00000100:00100000:3.0:1789065732.312537:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948160 00000100:00100000:0.0:1789065732.312605:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948032 00000100:00100000:0.0:1789065732.312609:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948032 00000100:00100000:0.0:1789065732.312643:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257947904 00000100:00100000:0.0:1789065732.312647:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257947904 00000100:00100000:0.0:1789065732.312669:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948288 00000100:00100000:0.0:1789065732.312672:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948288 00000100:00100000:0.0:1789065732.312686:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789065732.312692:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257948032:12345-0@lo:400: 00000100:00100000:3.0:1789065732.312728:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789065732.312735:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257948160:12345-0@lo:400: 00000100:00100000:3.0:1789065732.312773:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257948160:12345-0@lo:400: Request processed in 38us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.312780:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789065732.312815:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257948032:12345-0@lo:400: Request processed in 122us (759us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065732.312821:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789065732.312835:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789065732.312839:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789065732.312841:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257947904:12345-0@lo:400: 00000100:00100000:2.0:1789065732.312846:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257948288:12345-0@lo:400: 00000100:00100000:2.0:1789065732.312870:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257948288:12345-0@lo:400: Request processed in 25us (376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065732.312870:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257947904:12345-0@lo:400: Request processed in 29us (566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065732.312876:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789065732.312887:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789065732.312902:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789065732.312928:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a74aa00 x1875971257948288/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065732.312957:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257948288:0@lo:400: 00010000:00080000:0.0:1789065732.312971:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a748000 x1875971257948160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065732.312978:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257948160:0@lo:400: 00010000:00080000:0.0:1789065732.313009:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a74a680 x1875971257948032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065732.313017:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257948032:0@lo:400: 00010000:00080000:0.0:1789065732.313026:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a749500 x1875971257947904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065748 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065732.313032:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257947904:0@lo:400: 00002000:00080000:1.0:1789065732.313112:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789065732.313139:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf081895800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789065732.313185:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3294:x1875971257947776:12345-0@lo:8: Request processed in 955us (1433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065732.313201:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789065732.313232:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948416 00000100:00100000:1.0:1789065732.313236:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948416 00000100:00100000:1.0:1789065732.313261:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789065732.313268:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8068:x1875971257948416:12345-0@lo:502: 00000100:00100000:1.0:1789065732.313481:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8068:x1875971257948416:12345-0@lo:502: Request processed in 214us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065732.313488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:3.0:1789065732.313822:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a749f80 x1875971257947776/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789065742 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065732.313834:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789065732.313841:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789065732.313849:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789065732.313861:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789065732.313863:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf08164f800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789065732.313884:0:3294:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789065732.313890:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971257947776:0@lo:8: 00000004:00080000:3.0:1789065732.313914:0:8070:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1789065732.314007:0:8070:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 191507457824ns, next at 0ns, rc = 0 00000100:00100000:3.0:1789065732.314039:0:8068:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8068:1875971257948416:0@lo:502: 00000020:01000000:3.0:1789065732.314065:0:8068:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065732.314072:0:8068:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065732.314074:0:8068:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789065732.314079:0:8068:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1789065732.314134:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1789065732.314150:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789065732.314160:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314170:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065732.314180:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789065732.314182:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf0581e4d40 from 1 10000000:01000000:3.0:1789065732.314185:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789065732.314212:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314219:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314228:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.314254:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257948544:0@lo:101: 00000100:00100000:3.0:1789065732.314288:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.314314:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07a8ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.314328:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948544 00000100:00100000:3.0:1789065732.314333:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948544 00000100:00100000:3.0:1789065732.314358:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789065732.314364:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257948544:12345-0@lo:101: 00010000:00010000:3.0:1789065732.314374:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065732.314387:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8258d expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314409:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8258d expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314419:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8258d expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314427:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041683e00, rc 0) 00000100:00100000:3.0:1789065732.314528:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257948544:12345-0@lo:101: Request processed in 163us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.314535:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789065732.314724:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257948544:0@lo:101: 00010000:00010000:3.0:1789065732.314736:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.314745:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065732.314798:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257948672:0@lo:501: 00000100:00100000:3.0:1789065732.314821:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.314834:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07a8ee480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.314847:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948672 00000100:00100000:3.0:1789065732.314850:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948672 00000100:00100000:3.0:1789065732.314866:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789065732.314871:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257948672:12345-0@lo:501: 00000100:00100000:3.0:1789065732.315076:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257948672:12345-0@lo:501: Request processed in 203us (252us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789065732.315083:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789065732.315111:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257948672:0@lo:501: 10000000:01000000:3.0:1789065732.315129:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789065732.315135:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065732.315144:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065732.371122:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257948800:0@lo:13: 00000100:00100000:2.0:1789065732.371194:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789065732.371289:0:8071:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1789065732.371315:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257948928:0@lo:7: 00000100:00100000:1.0:1789065732.371348:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065732.371367:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf061aa5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065732.371412:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948800 00000100:00100000:3.0:1789065732.371421:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948800 00000100:00100000:3.0:1789065732.371613:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789065732.371750:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257948800:12345-0@lo:13: 00002000:00000024:3.0:1789065732.371784:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:1.0:1789065732.371882:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065732.371920:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058217100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257948800:12345-0@lo:13: Request processed in 174us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.371927:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789065732.371996:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ae66a00 x1875971257948800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065748 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065732.372014:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257948800:0@lo:13: 00000004:00080000:1.0:1789065732.372693:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789065732.374735:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257948928 00000100:00100000:3.0:1789065732.374750:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257948928 00000100:00100000:3.0:1789065732.374802:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789065732.374815:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8071:x1875971257948928:12345-0@lo:7: 00002000:00080000:2.0:1789065732.396096:0:6880:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789065732.396107:0:6880:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789065732.396404:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:8071:x1875971257948928:12345-0@lo:7: Request processed in 21412us (24875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065732.396417:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1789065732.396748:0:8071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ae64380 x1875971257948928/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789065748 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065732.396764:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257948928:0@lo:7: 00000004:00080000:1.0:1789065732.396779:0:8071:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1789065732.396817:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257949056:0@lo:5: 00000100:00100000:1.0:1789065732.396854:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065732.396895:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf061aa5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065732.396911:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949056 00000100:00100000:1.0:1789065732.396917:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949056 00000100:00100000:1.0:1789065732.396955:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789065732.396964:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8071:x1875971257949056:12345-0@lo:5: 00002000:00080000:1.0:1789065732.396989:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1789065732.397004:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1789065732.398138:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:8071:x1875971257949056:12345-0@lo:5: Request processed in 1164us (1273us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1789065732.398147:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789065732.398584:0:8071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ae64380 x1875971257949056/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789065748 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065732.398600:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257949056:0@lo:5: 00000004:00080000:3.0:1789065732.398612:0:8071:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789065732.398780:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257949184:0@lo:700: 00000100:00100000:3.0:1789065732.398816:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065732.398852:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535e6240 going to sleep for 11 seconds 00000100:00100000:1.0:1789065732.400762:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949184 00000100:00100000:1.0:1789065732.400775:0:6694:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949184 00000100:00100000:1.0:1789065732.400828:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065732.400838:0:6694:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8071:x1875971257949184:12345-0@lo:700: 00000100:00100000:1.0:1789065732.400888:0:6694:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875971257949312:0@lo:700: 00000100:00100000:1.0:1789065732.400957:0:6694:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065732.400987:0:6694:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf052b1ab40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065732.403286:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949312 00000100:00100000:0.0:1789065732.403300:0:5845:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949312 00000100:00100000:0.0:1789065732.403710:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789065732.403721:0:5845:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875971257949312:12345-0@lo:700: 40000000:02000000:2.0:1789065732.454325:0:5845:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1789065732.462124:0:5845:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6694:x1875971257949312:12345-0@lo:700: Request processed in 58397us (61159us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065732.462147:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789065732.462239:0:6694:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ae66a00 x1875971257949312/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789065748 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065732.462255:0:6694:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae66a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6694:1875971257949312:0@lo:700: 40000000:02000000:1.0:1789065732.462269:0:6694:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789065732.521011:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789065732.521031:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1789065732.521188:0:6694:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8071:x1875971257949184:12345-0@lo:700: Request processed in 120346us (122366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065732.521200:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789065732.521347:0:8071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a74b100 x1875971257949184/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789065748 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065732.521359:0:8071:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789065732.521374:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257949184:0@lo:700: 00000004:02000040:0.0:1789065732.545853:0:8071:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789065732.549901:0:8071:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257949440:0@lo:5: 00000100:00100000:0.0:1789065732.549994:0:8071:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065732.550121:0:8071:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cda80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065732.550200:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949440 00000100:00100000:2.0:1789065732.550209:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949440 00000100:00100000:2.0:1789065732.550299:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789065732.550317:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:8071:x1875971257949440:12345-0@lo:5: 00002000:00080000:3.0:1789065732.556075:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1789065732.556096:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1789065732.560704:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8071:x1875971257949440:12345-0@lo:5: Request processed in 10231us (10551us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789065732.560718:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789065732.560926:0:8071:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf0818db800 x1875971257949440/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789065748 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065732.560944:0:8071:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8071:1875971257949440:0@lo:5: 00000004:00080000:1.0:1789065732.560960:0:8071:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:0.0:1789065733.094472:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065734.117702:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065735.142306:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789065736.029062:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1789065736.167123:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065736.358097:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065736.358118:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257949568:0@lo:13: 00000100:00100000:2.0:1789065736.358183:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065736.360930:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949568 00000100:00100000:3.0:1789065736.360946:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949568 00000100:00100000:3.0:1789065736.361036:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789065736.361048:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257949568:12345-0@lo:13: 00002000:00000024:3.0:1789065736.361086:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065736.361172:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058216a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257949568:12345-0@lo:13: Request processed in 127us (2988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065736.361179:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789065736.361229:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058214700 x1875971257949568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065752 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065736.361252:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257949568:0@lo:13: 00000100:00080000:1.0:1789065736.361428:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065736.633765:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065736.633852:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235905664 00000100:00100000:1.0:1789065736.633874:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235905664 00000100:00100000:1.0:1789065736.633932:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00100000:1.0:1789065736.633943:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1875971235905664:12345-192.168.204.23@tcp:250: 00010000:00080000:1.0:1789065736.633980:0:5831:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from bfe1882a-aaa0-4536-9098-4c2a13a5b5ba@192.168.204.23@tcp t0 exp 0000000000000000 cur 195 last 0 00000020:00000080:1.0:1789065736.634033:0:5831:0:(genops.c:1384:class_connect()) connect: client bfe1882a-aaa0-4536-9098-4c2a13a5b5ba, cookie 0x7555615576c8259b 00000100:00080000:1.0:1789065736.634191:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9cf044fdd000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789065736.634264:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+5:2346:x1875971235905664:12345-192.168.204.23@tcp:250: Request processed in 322us (510us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.634272:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00100000:1.0:1789065736.641021:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065736.641147:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235905792 00000100:00100000:2.0:1789065736.641158:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235905792 00000100:00100000:2.0:1789065736.641216:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:2.0:1789065736.641234:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+5:5580:x1875971235905792:12345-192.168.204.23@tcp:101: 00010000:00010000:2.0:1789065736.641253:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065736.641276:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdb31 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065736.641315:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065736.641329:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065736.641341:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0413fd000, rc 0) 00000100:00100000:2.0:1789065736.641400:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+6:5580:x1875971235905792:12345-192.168.204.23@tcp:101: Request processed in 174us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065736.641408:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:3.0:1789065736.654941:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065736.654985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235905920 00000100:00100000:3.0:1789065736.654996:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235905920 00000100:00100000:3.0:1789065736.655059:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:3.0:1789065736.655072:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+6:5580:x1875971235905920:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1789065736.656239:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+6:5580:x1875971235905920:12345-192.168.204.23@tcp:501: Request processed in 1161us (1300us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789065736.656252:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:2.0:1789065736.682358:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065736.682526:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906048 00000100:00100000:3.0:1789065736.682537:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906048 00000100:00100000:3.0:1789065736.682622:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:3.0:1789065736.682633:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+6:5580:x1875971235906048:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1789065736.682650:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065736.682683:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdb38 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065736.682710:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065736.682721:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 7 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065736.682729:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041683200, rc 0) 00000100:00100000:3.0:1789065736.682786:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+7:5580:x1875971235906048:12345-192.168.204.23@tcp:101: Request processed in 154us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065736.682792:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:2.0:1789065736.685750:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065736.686270:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906176 00000100:00100000:3.0:1789065736.686280:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906176 00000100:00100000:3.0:1789065736.686346:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:3.0:1789065736.686355:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+7:5580:x1875971235906176:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1789065736.686710:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5580:x1875971235906176:12345-192.168.204.23@tcp:501: Request processed in 355us (969us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065736.686722:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:0.0:1789065736.695983:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065736.696242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906304 00000100:00100000:2.0:1789065736.696252:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906304 00000100:00100000:2.0:1789065736.696311:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:2.0:1789065736.696321:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5580:x1875971235906304:12345-192.168.204.23@tcp:503: 00000100:00100000:2.0:1789065736.696762:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5580:x1875971235906304:12345-192.168.204.23@tcp:503: Request processed in 440us (786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065736.696771:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:3.0:1789065736.704290:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065736.704790:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906432 00000100:00100000:2.0:1789065736.704802:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906432 00000100:00100000:2.0:1789065736.704863:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:2.0:1789065736.704874:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5598:x1875971235906432:12345-192.168.204.23@tcp:502: 00000100:00100000:2.0:1789065736.705226:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5598:x1875971235906432:12345-192.168.204.23@tcp:502: Request processed in 353us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065736.705235:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:3.0:1789065736.768678:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065736.768810:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906560 00000100:00100000:1.0:1789065736.768821:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906560 00000100:00100000:1.0:1789065736.768886:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:1.0:1789065736.768897:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5598:x1875971235906560:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1789065736.769184:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5598:x1875971235906560:12345-192.168.204.23@tcp:502: Request processed in 289us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.769192:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:0.0:1789065736.789487:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065736.789661:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906688 00000100:00100000:2.0:1789065736.789671:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906688 00000100:00100000:2.0:1789065736.789731:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:2.0:1789065736.789742:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5580:x1875971235906688:12345-192.168.204.23@tcp:101: 00010000:00010000:2.0:1789065736.789762:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065736.789786:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0413fc200/0x7555615576c825b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdb62 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065736.789821:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0413fc200/0x7555615576c825b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb62 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065736.789835:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0413fc200/0x7555615576c825b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb62 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065736.789846:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0413fc200, rc 0) 00000100:00100000:2.0:1789065736.789922:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5580:x1875971235906688:12345-192.168.204.23@tcp:101: Request processed in 181us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065736.789944:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:0.0:1789065736.793655:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065736.793744:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906816 00000100:00100000:3.0:1789065736.793754:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906816 00000100:00100000:3.0:1789065736.793801:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:3.0:1789065736.793811:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5580:x1875971235906816:12345-192.168.204.23@tcp:256: 20000000:01000000:3.0:1789065736.793836:0:5831:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789065736.793872:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789065736.793882:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789065736.793885:0:5831:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789065736.793887:0:5831:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789065736.798747:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5580:x1875971235906816:12345-192.168.204.23@tcp:256: Request processed in 4925us (5089us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.798763:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:0.0:1789065736.802024:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065736.802119:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235906944 00000100:00100000:1.0:1789065736.802130:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235906944 00000100:00100000:1.0:1789065736.802186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:1.0:1789065736.802195:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5580:x1875971235906944:12345-192.168.204.23@tcp:101: 00010000:00010000:1.0:1789065736.802211:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065736.802230:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdb69 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065736.802259:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065736.802291:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 10 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065736.802301:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073a00, rc 0) 00000100:00100000:1.0:1789065736.802364:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5580:x1875971235906944:12345-192.168.204.23@tcp:101: Request processed in 169us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.802371:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:0.0:1789065736.815114:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065736.815198:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907072 00000100:00100000:2.0:1789065736.815208:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907072 00000100:00100000:2.0:1789065736.815269:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:2.0:1789065736.815279:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5580:x1875971235907072:12345-192.168.204.23@tcp:501: 00000100:00100000:2.0:1789065736.815582:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5580:x1875971235907072:12345-192.168.204.23@tcp:501: Request processed in 303us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065736.815591:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:0.0:1789065736.818226:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065736.818299:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907200 00000100:00100000:1.0:1789065736.818311:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907200 00000100:00100000:1.0:1789065736.818361:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:1.0:1789065736.818371:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5580:x1875971235907200:12345-192.168.204.23@tcp:503: 00000100:00100000:1.0:1789065736.819094:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5580:x1875971235907200:12345-192.168.204.23@tcp:503: Request processed in 720us (872us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.819103:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:3.0:1789065736.822316:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065736.822406:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907328 00000100:00100000:1.0:1789065736.822418:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907328 00000100:00100000:1.0:1789065736.822481:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:1.0:1789065736.822492:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5603:x1875971235907328:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1789065736.822786:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5603:x1875971235907328:12345-192.168.204.23@tcp:502: Request processed in 295us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.822795:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:3.0:1789065736.828887:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065736.829004:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907456 00000100:00100000:1.0:1789065736.829015:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907456 00000100:00100000:1.0:1789065736.829084:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:1.0:1789065736.829095:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5603:x1875971235907456:12345-192.168.204.23@tcp:502: 00000100:00100000:1.0:1789065736.829328:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5603:x1875971235907456:12345-192.168.204.23@tcp:502: Request processed in 234us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065736.829336:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:1.0:1789065736.836321:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065736.836428:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907584 00000100:00100000:2.0:1789065736.836441:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907584 00000100:00100000:2.0:1789065736.836499:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1789065736.836508:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2346:x1875971235907584:12345-192.168.204.23@tcp:38: 00010000:00080000:2.0:1789065736.836584:0:5839:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1789065736.836633:0:5839:0:(genops.c:1384:class_connect()) connect: client 241917dc-ba0e-425a-830a-a04cd9f8b120, cookie 0x7555615576c825be 00000004:00100000:2.0:1789065736.836663:0:5839:0:(mdt_handler.c:7352:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789065736.836670:0:5839:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789065736.892121:0:5839:0:(import.c:65:import_set_state_nolock()) ffff9cf07b232800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789065736.892203:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2346:x1875971235907584:12345-192.168.204.23@tcp:38: Request processed in 55693us (55892us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065736.892216:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00010000:00010000:3.0:1789065737.203725:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065737.381984:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065737.382013:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257949696:0@lo:13: 00000100:00100000:2.0:1789065737.382085:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065737.383020:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949696 00000100:00100000:3.0:1789065737.383032:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949696 00000100:00100000:3.0:1789065737.383117:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789065737.383127:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257949952:0@lo:400: 00000100:00100000:3.0:1789065737.383130:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257949696:12345-0@lo:13: 00002000:00000024:3.0:1789065737.383171:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065737.383176:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065737.383224:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257949696:12345-0@lo:13: Request processed in 97us (1138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065737.383232:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789065737.383240:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065737.383249:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257950080:0@lo:400: 00000100:00100000:2.0:1789065737.383276:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065737.383302:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257950208:0@lo:400: 00000100:00100000:2.0:1789065737.383313:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949952 00000100:00100000:2.0:1789065737.383318:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949952 00000100:00100000:3.0:1789065737.383338:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065737.383353:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950080 00000100:00100000:2.0:1789065737.383357:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950080 00000100:00100000:3.0:1789065737.383367:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789065737.383376:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257949824:0@lo:400: 00000100:00100000:2.0:1789065737.383381:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789065737.383390:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257949952:12345-0@lo:400: 00000100:00100000:3.0:1789065737.383409:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065737.383435:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257950336:0@lo:400: 00000100:00100000:2.0:1789065737.383453:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257949952:12345-0@lo:400: Request processed in 63us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065737.383464:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065737.383465:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789065737.383484:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950336 00000100:00100000:2.0:1789065737.383488:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950336 00000100:00100000:3.0:1789065737.383497:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950208 00000100:00100000:3.0:1789065737.383502:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950208 00000100:00100000:2.0:1789065737.383509:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789065737.383517:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257950080:12345-0@lo:400: 00000100:00100000:3.0:1789065737.383536:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789065737.383581:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257950208:12345-0@lo:400: 00000100:00100000:2.0:1789065737.383587:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257950080:12345-0@lo:400: Request processed in 69us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065737.383594:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789065737.383610:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789065737.383618:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257950336:12345-0@lo:400: 00000100:00100000:3.0:1789065737.383626:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257950208:12345-0@lo:400: Request processed in 81us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065737.383633:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789065737.383657:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257950336:12345-0@lo:400: Request processed in 40us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065737.383664:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789065737.383667:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257949824 00000100:00100000:3.0:1789065737.383672:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257949824 00000100:00100000:3.0:1789065737.383699:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789065737.383706:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257949824:12345-0@lo:400: 00010000:00080000:2.0:1789065737.383716:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058216d80 x1875971257950080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065737.383731:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058216d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257950080:0@lo:400: 00000100:00100000:3.0:1789065737.383740:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257949824:12345-0@lo:400: Request processed in 34us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065737.383751:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00010000:00080000:2.0:1789065737.383762:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058214700 x1875971257949952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065737.383772:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257949952:0@lo:400: 00000100:00100000:3.0:1789065737.383790:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058216300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257949824:0@lo:400: 00010000:00080000:3.0:1789065737.383804:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058215180 x1875971257950336/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065737.383813:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257950336:0@lo:400: 00010000:00080000:3.0:1789065737.383822:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058215c00 x1875971257950208/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065753 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065737.383830:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257950208:0@lo:400: 00010000:00080000:1.0:1789065737.384023:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f482d80 x1875971257949696/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065753 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065737.384032:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:1.0:1789065737.384054:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257949696:0@lo:13: 00000100:00080000:0.0:1789065737.384121:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789065737.384126:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065737.895093:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065737.895233:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907712 00000100:00100000:2.0:1789065737.895246:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907712 00000100:00100000:2.0:1789065737.895338:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1789065737.895350:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:0:x1875971235907712:12345-192.168.204.23@tcp:41: 00000004:00000024:2.0:1789065737.895399:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789065737.895493:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:0:x1875971235907712:12345-192.168.204.23@tcp:41: Request processed in 145us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065737.895500:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00080000:0.0:1789065737.895721:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065737.900722:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065737.901055:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907840 00000100:00100000:2.0:1789065737.901067:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907840 00000100:00100000:2.0:1789065737.901193:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1789065737.901205:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5580:x1875971235907840:12345-192.168.204.23@tcp:41: 00000004:00000024:2.0:1789065737.901240:0:5839:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789065737.901320:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5580:x1875971235907840:12345-192.168.204.23@tcp:41: Request processed in 116us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065737.901329:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1789065737.903984:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065737.904070:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235907968 00000100:00100000:3.0:1789065737.904080:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235907968 00000100:00100000:3.0:1789065737.904143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1789065737.904153:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5580:x1875971235907968:12345-192.168.204.23@tcp:40: 00000100:00100000:3.0:1789065737.904342:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f482d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5580:x1875971235907968:12345-192.168.204.23@tcp:40: Request processed in 189us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065737.904350:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789065737.908597:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065737.908683:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065737.908715:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065737.908756:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065737.908815:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908480 00000100:00100000:0.0:1789065737.908826:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908480 00000100:00100000:0.0:1789065737.908876:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:0.0:1789065737.908886:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235908480:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1789065737.908959:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235908480:12345-192.168.204.23@tcp:400: Request processed in 74us (201us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065737.908967:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:1.0:1789065737.909148:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908096 00000100:00100000:1.0:1789065737.909153:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908096 00000100:00100000:1.0:1789065737.909192:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908224 00000100:00100000:1.0:1789065737.909195:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908224 00000100:00100000:1.0:1789065737.909214:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1789065737.909219:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875971235908096:12345-192.168.204.23@tcp:8: 00010000:00080000:1.0:1789065737.909246:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1789065737.909282:0:6688:0:(genops.c:1384:class_connect()) connect: client 241917dc-ba0e-425a-830a-a04cd9f8b120, cookie 0x7555615576c825c5 00002000:00100000:1.0:1789065737.909294:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 241917dc-ba0e-425a-830a-a04cd9f8b120/ffff9cf044fd8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789065737.909320:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789065737.909932:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1789065737.909940:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875971235908224:12345-192.168.204.23@tcp:8: 00010000:00080000:0.0:1789065737.909963:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:0.0:1789065737.909983:0:6687:0:(genops.c:1384:class_connect()) connect: client 241917dc-ba0e-425a-830a-a04cd9f8b120, cookie 0x7555615576c825cc 00002000:00100000:0.0:1789065737.909990:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 241917dc-ba0e-425a-830a-a04cd9f8b120/ffff9cf081645800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789065737.909997:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789065737.910279:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789065737.910314:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf081646000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789065737.910378:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2346:x1875971235908224:12345-192.168.204.23@tcp:8: Request processed in 434us (1659us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065737.910387:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1789065737.910508:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908352 00000100:00100000:3.0:1789065737.910516:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908352 00000100:00100000:3.0:1789065737.910587:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1789065737.910600:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5580:x1875971235908352:12345-192.168.204.23@tcp:33: 00002000:00080000:1.0:1789065737.911521:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789065737.911582:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9cf044fd9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789065737.913718:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2346:x1875971235908096:12345-192.168.204.23@tcp:8: Request processed in 4487us (5025us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065737.913733:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000004:00080000:1.0:1789065737.956829:0:5841:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 45993us 00000004:00200000:2.0:1789065737.986599:0:5841:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789065737.986746:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5580:x1875971235908352:12345-192.168.204.23@tcp:33: Request processed in 76146us (78294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065737.986762:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00010000:00010000:0.0:1789065738.214521:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065738.252269:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065738.252619:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908608 00000100:00100000:2.0:1789065738.252631:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908608 00000100:00100000:2.0:1789065738.252713:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:2.0:1789065738.252744:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5620:x1875971235908608:12345-192.168.204.23@tcp:101: 00010000:00010000:2.0:1789065738.252768:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065738.252852:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fd200/0x7555615576c825d3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdb93 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065738.252937:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c825da lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065738.252951:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c825da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065738.252968:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c825da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065738.253026:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789065738.253031:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065738.253051:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c825da lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065738.253078:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fd200/0x7555615576c825d3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb93 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065738.253101:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c825da lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb93 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065738.253109:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065738.253112:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065738.253116:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d400, rc 0) 00000100:00100000:2.0:1789065738.253192:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:5620:x1875971235908608:12345-192.168.204.23@tcp:101: Request processed in 452us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065738.253208:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:1.0:1789065739.238663:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065740.261747:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065740.604351:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065740.604440:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908736 00000100:00100000:3.0:1789065740.604451:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908736 00000100:00100000:3.0:1789065740.604541:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1789065740.604587:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:5673:x1875971235908736:12345-192.168.204.23@tcp:41: 00000004:00000024:3.0:1789065740.604633:0:5840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789065740.604711:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:5673:x1875971235908736:12345-192.168.204.23@tcp:41: Request processed in 160us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065740.604719:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00080000:0.0:1789065740.604873:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065740.618620:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065740.618705:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908864 00000100:00100000:3.0:1789065740.618716:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908864 00000100:00100000:3.0:1789065740.618806:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1789065740.618817:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5673:x1875971235908864:12345-192.168.204.23@tcp:13: 00002000:00000024:3.0:1789065740.618862:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065740.618943:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f482300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5673:x1875971235908864:12345-192.168.204.23@tcp:13: Request processed in 121us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065740.618950:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00080000:0.0:1789065740.619165:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789065740.631615:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065740.631701:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235908992 00000100:00100000:3.0:1789065740.631711:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235908992 00000100:00100000:3.0:1789065740.631786:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1789065740.631798:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5673:x1875971235908992:12345-192.168.204.23@tcp:13: 00002000:00000024:3.0:1789065740.631836:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065740.631906:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:241917dc-ba0e-425a-830a-a04cd9f8b120+6:5673:x1875971235908992:12345-192.168.204.23@tcp:13: Request processed in 109us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065740.631930:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00080000:0.0:1789065740.632010:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789065741.288171:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065741.478188:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257950464:0@lo:13: 00000100:00100000:0.0:1789065741.478297:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065741.478389:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950464 00000100:00100000:0.0:1789065741.478400:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950464 00000100:00100000:0.0:1789065741.478470:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789065741.478494:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257950464:12345-0@lo:13: 00002000:00000024:0.0:1789065741.478526:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065741.478604:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257950464:12345-0@lo:13: Request processed in 112us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065741.478612:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:0.0:1789065741.478639:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065741.478676:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a749500 x1875971257950464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065757 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065741.478700:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257950464:0@lo:13: 00000001:00100000:1.0:1789065741.618614:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000001:00100000:0.0:1789065742.028632:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000001:00100000:0.0:1789065742.037930:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00010000:00010000:1.0:1789065742.309890:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065742.501883:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257950592:0@lo:13: 00000100:00100000:2.0:1789065742.501961:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065742.502594:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257950976:0@lo:400: 00000100:00100000:2.0:1789065742.502623:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257950720:0@lo:400: 00000100:00100000:0.0:1789065742.502646:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065742.502755:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950976 00000100:00100000:3.0:1789065742.502764:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950976 00000100:00100000:3.0:1789065742.502830:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789065742.502841:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257950976:12345-0@lo:400: 00000100:00100000:1.0:1789065742.502930:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950592 00000100:00100000:1.0:1789065742.502934:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950592 00000100:00100000:1.0:1789065742.502967:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789065742.502975:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257950592:12345-0@lo:13: 00002000:00000024:1.0:1789065742.503006:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065742.511468:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065742.511491:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257951104:0@lo:400: 00000100:00100000:0.0:1789065742.511584:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789065742.511629:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789065742.511635:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065742.511650:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951104 00000100:00100000:0.0:1789065742.511658:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951104 00000100:00100000:0.0:1789065742.511712:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065742.511721:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257951104:12345-0@lo:400: 00000100:00100000:0.0:1789065742.511778:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257951104:12345-0@lo:400: Request processed in 58us (194us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065742.511786:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1789065742.511842:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a749500 x1875971257951104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065758 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065742.511877:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065742.511970:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257951232:0@lo:400: 00000100:00100000:0.0:1789065742.512025:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257951104:0@lo:400: 00000100:00100000:2.0:1789065742.512041:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065742.512096:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257950848:0@lo:400: 00000100:00100000:2.0:1789065742.512124:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789065742.512138:0:5839:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789065742.512147:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065742.512203:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950720 00000100:00100000:0.0:1789065742.512209:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950720 00000100:00100000:0.0:1789065742.512247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1789065742.512257:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257950720:12345-0@lo:400: 00000100:00100000:0.0:1789065742.512308:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257950720:12345-0@lo:400: Request processed in 52us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065742.512315:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:2.0:1789065742.512326:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951232 00000100:00100000:2.0:1789065742.512335:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951232 00000100:00080000:0.0:1789065742.512378:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065742.512400:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789065742.512410:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257950848 00000100:00100000:2.0:1789065742.512415:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257950848 00000100:00100000:0.0:1789065742.512416:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257950720:0@lo:400: 00000100:00100000:3.0:1789065742.512740:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257950976:12345-0@lo:400: Request processed in 9900us (10093us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065742.512750:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789065742.512773:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789065742.512784:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257951232:12345-0@lo:400: 00000100:00100000:2.0:1789065742.512824:0:5839:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789065742.512836:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257951232:12345-0@lo:400: Request processed in 54us (797us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065742.512843:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789065742.512855:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257950848:12345-0@lo:400: 00000100:00100000:3.0:1789065742.512868:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789065742.512936:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257950848:12345-0@lo:400: Request processed in 81us (789us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065742.512944:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789065742.517408:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257950592:12345-0@lo:13: Request processed in 14423us (15436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065742.517425:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789065742.517857:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257951232:0@lo:400: 00010000:00080000:2.0:1789065742.518023:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f483100 x1875971257950592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065758 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065742.518060:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257950592:0@lo:13: 00000100:00100000:0.0:1789065742.518275:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a748000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257950848:0@lo:400: 00000100:00100000:0.0:1789065742.518310:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257950976:0@lo:400: 00000100:00100000:1.0:1789065743.266289:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065743.266345:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065743.266392:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065743.266461:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065743.266501:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909248 00000100:00100000:1.0:1789065743.266515:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909248 00000100:00100000:1.0:1789065743.266627:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1789065743.266640:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235909248:12345-192.168.204.23@tcp:400: 00000100:00100000:1.0:1789065743.266740:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235909248:12345-192.168.204.23@tcp:400: Request processed in 102us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065743.266749:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1789065743.266777:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909376 00000100:00100000:1.0:1789065743.266781:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909376 00000100:00100000:1.0:1789065743.266828:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909504 00000100:00100000:1.0:1789065743.266832:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909504 00000100:00100000:1.0:1789065743.266852:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1789065743.266858:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235909376:12345-192.168.204.23@tcp:400: 00000100:00100000:1.0:1789065743.266886:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235909376:12345-192.168.204.23@tcp:400: Request processed in 28us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065743.266893:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1789065743.266903:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1789065743.266909:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235909504:12345-192.168.204.23@tcp:400: 00000100:00100000:1.0:1789065743.266929:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235909504:12345-192.168.204.23@tcp:400: Request processed in 21us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065743.266936:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00080000:1.0:1789065743.266950:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789065743.266954:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789065743.266957:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065743.267256:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909120 00000100:00100000:3.0:1789065743.267262:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909120 00000100:00100000:3.0:1789065743.267300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00100000:3.0:1789065743.267307:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235909120:12345-192.168.204.23@tcp:400: 00000100:00100000:3.0:1789065743.267343:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235909120:12345-192.168.204.23@tcp:400: Request processed in 36us (1070us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065743.267349:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 130 00010000:00010000:3.0:1789065743.333713:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789065744.256479:0:8292:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:1.0:1789065744.360767:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065745.383327:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065746.405697:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065746.607943:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257951360:0@lo:13: 00000100:00100000:0.0:1789065746.608049:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065746.609335:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951360 00000100:00100000:0.0:1789065746.609350:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951360 00000100:00100000:0.0:1789065746.609457:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789065746.609470:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257951360:12345-0@lo:13: 00002000:00000024:0.0:1789065746.609520:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065746.609629:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257951360:12345-0@lo:13: Request processed in 162us (1580us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065746.609638:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1789065746.609667:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065746.609706:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edd3b80 x1875971257951360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065762 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065746.609731:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257951360:0@lo:13: 00010000:00010000:1.0:1789065747.429717:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065747.624639:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257951488:0@lo:400: 00000100:00100000:0.0:1789065747.624746:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065747.624805:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257952000:0@lo:400: 00000100:00100000:0.0:1789065747.624833:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065747.624863:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789065747.624869:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257951616:0@lo:400: 00000100:00100000:0.0:1789065747.624893:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065747.624921:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257952128:0@lo:400: 00000100:00100000:0.0:1789065747.624949:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065747.624982:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257951744:0@lo:400: 00000100:00100000:0.0:1789065747.625005:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065747.625025:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065747.625030:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257951872:0@lo:400: 00000100:00100000:0.0:1789065747.625050:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065747.625090:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951488 00000100:00100000:0.0:1789065747.625101:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951488 00000100:00100000:0.0:1789065747.625162:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789065747.625172:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257951488:12345-0@lo:400: 00000100:00100000:0.0:1789065747.625229:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257951488:12345-0@lo:400: Request processed in 58us (484us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065747.625250:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789065747.625762:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257952128 00000100:00100000:0.0:1789065747.625769:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257952128 00000100:00100000:0.0:1789065747.625821:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951872 00000100:00100000:0.0:1789065747.625825:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951872 00000100:00100000:0.0:1789065747.625848:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789065747.625855:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257952128:12345-0@lo:400: 00000100:00100000:0.0:1789065747.625900:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257952128:12345-0@lo:400: Request processed in 44us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065747.625906:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789065747.625920:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789065747.625926:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257951872:12345-0@lo:400: 00000100:00100000:0.0:1789065747.625959:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257951872:12345-0@lo:400: Request processed in 33us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065747.625977:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789065747.626001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257952000 00000100:00100000:0.0:1789065747.626005:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257952000 00000100:00100000:0.0:1789065747.626035:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951616 00000100:00100000:0.0:1789065747.626038:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951616 00000100:00100000:0.0:1789065747.626048:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257951744 00000100:00100000:0.0:1789065747.626050:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257951744 00000100:00100000:0.0:1789065747.626067:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065747.626073:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257952000:12345-0@lo:400: 00000100:00100000:0.0:1789065747.626109:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257952000:12345-0@lo:400: Request processed in 36us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065747.626115:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065747.626127:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065747.626133:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257951616:12345-0@lo:400: 00000100:00100000:0.0:1789065747.626157:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257951616:12345-0@lo:400: Request processed in 25us (1264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065747.626162:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065747.626171:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789065747.626176:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257951744:12345-0@lo:400: 00000100:00100000:0.0:1789065747.626197:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257951744:12345-0@lo:400: Request processed in 22us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065747.626203:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1789065747.626223:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789065747.626229:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065747.628470:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257951616:0@lo:400: 00010000:00080000:1.0:1789065747.628511:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edd2680 x1875971257952128/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065747.628522:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257952128:0@lo:400: 00000100:00100000:1.0:1789065747.628534:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257951488:0@lo:400: 00000100:00100000:1.0:1789065747.629446:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257952000:0@lo:400: 00010000:00080000:2.0:1789065747.631763:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edd2a00 x1875971257951872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065763 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065747.631806:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257951872:0@lo:400: 00000100:00100000:2.0:1789065747.631843:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257951744:0@lo:400: 00000100:00100000:2.0:1789065747.631897:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257952256:0@lo:13: 00000100:00100000:2.0:1789065747.631983:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065747.632054:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257952256 00000100:00100000:2.0:1789065747.632064:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257952256 00000100:00100000:2.0:1789065747.632133:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789065747.632144:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257952256:12345-0@lo:13: 00002000:00000024:2.0:1789065747.632201:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065747.632255:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257952256:12345-0@lo:13: Request processed in 113us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065747.632262:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789065747.632299:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f480380 x1875971257952256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065763 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065747.632313:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257952256:0@lo:13: 00000100:00100000:1.0:1789065748.390091:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065748.390191:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065748.390358:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909632 00000100:00100000:0.0:1789065748.390372:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909632 00000100:00100000:0.0:1789065748.390444:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 132 00000100:00100000:0.0:1789065748.390457:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235909632:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1789065748.390588:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235909632:12345-192.168.204.23@tcp:400: Request processed in 133us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065748.390597:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 132 00000100:00100000:0.0:1789065748.390640:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909760 00000100:00100000:0.0:1789065748.390644:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909760 00000100:00100000:0.0:1789065748.390690:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1789065748.390697:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235909760:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1789065748.390734:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235909760:12345-192.168.204.23@tcp:400: Request processed in 38us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065748.390740:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00080000:0.0:1789065748.390760:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065748.391732:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065748.391762:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065748.391830:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910016 00000100:00100000:3.0:1789065748.391841:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910016 00000100:00100000:0.0:1789065748.391864:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235909888 00000100:00100000:0.0:1789065748.391870:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235909888 00000100:00100000:3.0:1789065748.391950:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1789065748.391960:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235910016:12345-192.168.204.23@tcp:400: 00000100:00100000:3.0:1789065748.392025:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235910016:12345-192.168.204.23@tcp:400: Request processed in 67us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065748.392033:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1789065748.392220:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1789065748.392228:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235909888:12345-192.168.204.23@tcp:400: 00000100:00100000:0.0:1789065748.392263:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235909888:12345-192.168.204.23@tcp:400: Request processed in 36us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065748.392270:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00080000:1.0:1789065748.392767:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789065748.392827:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789065748.455388:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789065749.279738:0:8441:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdae69ad50 20000000:00000080:3.0:1789065749.279765:0:8441:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf07adae800 uarg=0000000000000000 20000000:01000000:3.0:1789065749.279898:0:8441:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1789065749.279901:0:8441:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1789065749.279904:0:8441:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789065749.279912:0:8441:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1789065749.279919:0:8441:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1789065749.279939:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789065749.279942:0:8441:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1789065749.280213:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1789065749.280217:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789065749.281988:0:8442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:0.0:1789065749.294484:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:0.0:1789065749.294603:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:0.0:1789065749.294670:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:0.0:1789065749.294693:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1789065749.294696:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789065749.295896:0:8443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1789065749.305293:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1789065749.305412:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:1.0:1789065749.305457:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:1.0:1789065749.305475:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789065749.305478:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789065749.309647:0:8444:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1789065749.311125:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1789065749.311202:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1789065749.311238:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:1.0:1789065749.311254:0:8441:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789065749.311257:0:8441:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1789065749.316303:0:8445:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:0.0:1789065749.317283:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:0.0:1789065749.317405:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:0.0:1789065749.317438:0:8441:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 10000000:01000000:0.0:1789065749.317459:0:8441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789065749.317485:0:8441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.317509:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824d7 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.317517:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82501 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.317524:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8252b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.317530:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82539 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.317537:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82547 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.317544:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82563 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318026:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8258d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318038:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318046:0:8441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318066:0:8441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318167:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 9 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318186:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 9 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318206:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952384:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065749.318400:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318409:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 9 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318419:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952512:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065749.318448:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8258d expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318456:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8258d expref: 18 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318466:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952640:0@lo:104: 00000100:00100000:0.0:1789065749.318518:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789065749.318597:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82563 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318619:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82563 expref: 18 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318787:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952768:0@lo:104: 00000100:00100000:0.0:1789065749.318819:0:8441:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789065749.318862:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82547 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318871:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82547 expref: 18 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318879:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952896:0@lo:104: 00010000:00010000:0.0:1789065749.318907:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82539 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318915:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82539 expref: 18 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318923:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953024:0@lo:104: 00010000:00010000:0.0:1789065749.318948:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8252b expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.318957:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8252b expref: 18 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.318966:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953152:0@lo:104: 00010000:00010000:0.0:1789065749.318990:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82501 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.319009:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82501 expref: 18 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.319017:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953280:0@lo:104: 00010000:00010000:0.0:1789065749.319043:0:8441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c824d7 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.319050:0:8441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c824d7 expref: 18 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065749.319058:0:8441:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953408:0@lo:104: 00000100:00100000:0.0:1789065749.319077:0:8441:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065749.319203:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789065749.319226:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.319242:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.319250:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.319271:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.319284:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.319295:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257952640 00000100:00100000:2.0:1789065749.319304:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257952640 00000100:00100000:2.0:1789065749.319365:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257952768 00000100:00100000:2.0:1789065749.319368:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257952768 00000100:00100000:2.0:1789065749.319388:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257952896 00000100:00100000:2.0:1789065749.319391:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257952896 00000100:00100000:2.0:1789065749.319400:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953024 00000100:00100000:2.0:1789065749.319402:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953024 00000100:00100000:2.0:1789065749.319410:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953152 00000100:00100000:2.0:1789065749.319412:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953152 00000100:00100000:2.0:1789065749.319420:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953280 00000100:00100000:2.0:1789065749.319422:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953280 00000100:00100000:2.0:1789065749.319430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953408 00000100:00100000:2.0:1789065749.319433:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953408 00000100:00100000:2.0:1789065749.319447:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789065749.319457:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:8441:x1875971257952640:12345-0@lo:104: 00010000:00010000:2.0:1789065749.319475:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.319576:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789065749.319583:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+9:8441:x1875971257952640:12345-0@lo:104: Request processed in 128us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.319591:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789065749.319611:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789065749.319618:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ece5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+8:8441:x1875971257952768:12345-0@lo:104: 00010000:00010000:2.0:1789065749.319627:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.319920:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789065749.319925:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ece5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+8:8441:x1875971257952768:12345-0@lo:104: Request processed in 309us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.319931:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789065749.319969:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789065749.319976:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+7:8441:x1875971257952896:12345-0@lo:104: 00010000:00010000:2.0:1789065749.319990:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320023:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1789065749.320028:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+7:8441:x1875971257952896:12345-0@lo:104: Request processed in 54us (801us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.320034:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789065749.320046:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789065749.320051:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+6:8441:x1875971257953024:12345-0@lo:104: 00010000:00010000:2.0:1789065749.320058:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320082:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1789065749.320086:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+6:8441:x1875971257953024:12345-0@lo:104: Request processed in 36us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.320091:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789065749.320102:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789065749.320107:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:8441:x1875971257953152:12345-0@lo:104: 00010000:00010000:2.0:1789065749.320114:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320140:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1789065749.320145:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058216300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:8441:x1875971257953152:12345-0@lo:104: Request processed in 38us (894us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.320151:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789065749.320161:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789065749.320167:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:8441:x1875971257953280:12345-0@lo:104: 00010000:00010000:2.0:1789065749.320180:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320209:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1789065749.320214:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:8441:x1875971257953280:12345-0@lo:104: Request processed in 47us (942us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.320219:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789065749.320232:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789065749.320238:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:8441:x1875971257953408:12345-0@lo:104: 00010000:00010000:2.0:1789065749.320245:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320268:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1789065749.320273:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:8441:x1875971257953408:12345-0@lo:104: Request processed in 36us (988us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065749.320279:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789065749.320301:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1789065749.320308:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320316:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fea00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065749.320320:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320343:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065749.320351:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065749.320363:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789065749.320404:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320411:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065749.320435:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320444:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821fea00/0x7555615576c8258d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82594 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320459:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1789065749.320462:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320467:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff000 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065749.320471:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320478:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065749.320483:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065749.320489:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789065749.320501:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320508:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065749.320530:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320539:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff000/0x7555615576c82563 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8256a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320573:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1789065749.320576:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320582:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff800 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065749.320585:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320591:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065749.320597:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065749.320602:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789065749.320616:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.320622:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789065749.320936:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952640:0@lo:104: 00000100:00100000:0.0:1789065749.320948:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952768:0@lo:104: 00000100:00100000:0.0:1789065749.320956:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952896:0@lo:104: 00000100:00100000:0.0:1789065749.320963:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd23480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953024:0@lo:104: 00000100:00100000:0.0:1789065749.320970:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd23100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953152:0@lo:104: 00000100:00100000:0.0:1789065749.320976:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953280:0@lo:104: 00000100:00100000:0.0:1789065749.320982:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257953408:0@lo:104: 00010000:00010000:3.0:1789065749.321238:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1789065749.321246:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321254:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031600 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065749.321258:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321266:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065749.321275:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065749.321293:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065749.321316:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321323:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065749.321365:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321374:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c82539 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82540 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321385:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789065749.321388:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321394:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031c00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065749.321397:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321403:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065749.321409:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065749.321414:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065749.321427:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321432:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065749.321443:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321449:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031c00/0x7555615576c8252b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82532 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321458:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789065749.321462:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321468:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fc800 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065749.321471:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321478:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065749.321484:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065749.321490:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065749.321502:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321508:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065749.321512:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321518:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0413fc800/0x7555615576c82501 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82508 expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321527:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065749.321536:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321542:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065749.321584:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321594:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065749.321600:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065749.321606:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789065749.321647:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321653:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065749.321658:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321663:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff200/0x7555615576c824d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824de expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.321672:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065749.321674:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065749.321676:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065749.321740:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.321749:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff800/0x7555615576c82547 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8254e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.321764:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065749.321772:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065749.321774:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065749.321783:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065749.321803:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257953536:0@lo:103: 00000100:00100000:2.0:1789065749.321870:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.321920:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257954048:0@lo:103: 00000100:00100000:2.0:1789065749.321942:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.321964:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065749.321970:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257953920:0@lo:103: 00000100:00100000:2.0:1789065749.321992:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.322034:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257953664:0@lo:103: 00000100:00100000:2.0:1789065749.322056:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.322066:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257954176:0@lo:103: 00000100:00100000:2.0:1789065749.322082:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.322092:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789065749.322097:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257953792:0@lo:103: 00000100:00100000:2.0:1789065749.322115:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065749.322125:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257954304:0@lo:103: 00000100:00100000:2.0:1789065749.322145:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065749.322610:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953536 00000100:00100000:3.0:1789065749.322622:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953536 00010000:00010000:3.0:1789065749.322812:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8258d expref: 19 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.322853:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954048 00000100:00100000:3.0:1789065749.322857:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954048 00010000:00010000:3.0:1789065749.322872:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8252b expref: 20 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.322883:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953920 00000100:00100000:3.0:1789065749.322886:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953920 00010000:00010000:3.0:1789065749.322898:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82539 expref: 21 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.322909:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953664 00000100:00100000:3.0:1789065749.322911:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953664 00010000:00010000:3.0:1789065749.322922:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82563 expref: 22 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.322931:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954176 00000100:00100000:3.0:1789065749.322934:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954176 00010000:00010000:3.0:1789065749.322944:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82501 expref: 23 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.322953:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257953792 00000100:00100000:3.0:1789065749.322956:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257953792 00010000:00010000:3.0:1789065749.322966:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82547 expref: 24 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.322977:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954304 00000100:00100000:3.0:1789065749.322979:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954304 00010000:00010000:3.0:1789065749.322989:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c824d7 expref: 25 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.323002:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789065749.323019:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+25:3298:x1875971257953536:12345-0@lo:103: 00010000:00010000:3.0:1789065749.323036:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.323042:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8258d expref: 25 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323053:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8258d expref: 25 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323071:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041683e00/0x7555615576c82594 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8258d expref: 25 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323088:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.323154:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+24:3298:x1875971257953536:12345-0@lo:103: Request processed in 136us (1283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.323161:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789065749.323183:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789065749.323189:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+23:3298:x1875971257954048:12345-0@lo:103: 00010000:00010000:3.0:1789065749.323196:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.323200:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8252b expref: 23 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323209:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8252b expref: 23 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323219:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821ffc00/0x7555615576c82532 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8252b expref: 23 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323229:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.323253:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+22:3298:x1875971257954048:12345-0@lo:103: Request processed in 64us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.323269:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789065749.323282:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789065749.323288:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+21:3298:x1875971257953920:12345-0@lo:103: 00010000:00010000:3.0:1789065749.323296:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.323300:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82539 expref: 21 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323309:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82539 expref: 21 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323319:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821fe800/0x7555615576c82540 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82539 expref: 21 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323342:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.323367:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+20:3298:x1875971257953920:12345-0@lo:103: Request processed in 79us (1373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.323373:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789065749.323385:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789065749.323391:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257953664:12345-0@lo:103: 00010000:00010000:3.0:1789065749.323399:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.323404:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82563 expref: 19 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323413:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82563 expref: 19 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323423:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073600/0x7555615576c8256a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82563 expref: 19 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323443:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.323478:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3295:x1875971257953664:12345-0@lo:103: Request processed in 87us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.323483:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789065749.323495:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789065749.323501:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3295:x1875971257954176:12345-0@lo:103: 00010000:00010000:3.0:1789065749.323508:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.323512:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82501 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323519:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82501 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323528:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fc600/0x7555615576c82508 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82501 expref: 17 pid: 5831 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.323538:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.323592:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3295:x1875971257954176:12345-0@lo:103: Request processed in 90us (1508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.323598:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789065749.323610:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789065749.323616:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3295:x1875971257953792:12345-0@lo:103: 00010000:00010000:3.0:1789065749.323624:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789065749.323965:0:5825:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789065749.323978:0:5825:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789065749.324095:0:5823:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789065749.324119:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789065749.324128:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3295:x1875971257954304:12345-0@lo:103: 00010000:00010000:0.0:1789065749.324139:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065749.324145:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c824d7 expref: 15 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.324169:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c824d7 expref: 15 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.324181:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821ffa00/0x7555615576c824de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c824d7 expref: 15 pid: 5832 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065749.324192:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065749.324231:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e0a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3295:x1875971257954304:12345-0@lo:103: Request processed in 105us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065749.324238:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789065749.324946:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257953920:0@lo:103: 00000100:00100000:2.0:1789065749.324964:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257953536:0@lo:103: 00010000:00010000:3.0:1789065749.324976:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82547 expref: 15 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065749.324976:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257954048:0@lo:103: 00010000:00010000:3.0:1789065749.324995:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82547 expref: 13 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.325020:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040031800/0x7555615576c8254e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82547 expref: 13 pid: 5833 timeout: 358 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.325034:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.325081:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:3295:x1875971257953792:12345-0@lo:103: Request processed in 1465us (2964us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.325089:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789065749.325180:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257953792:0@lo:103: 00000100:00100000:3.0:1789065749.325190:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257954304:0@lo:103: 00000100:00100000:3.0:1789065749.325212:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257953664:0@lo:103: 00000100:00100000:3.0:1789065749.325223:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257954176:0@lo:103: 00000100:00100000:1.0:1789065749.330015:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065749.330058:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065749.330166:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910144 00000100:00100000:3.0:1789065749.330180:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910144 00000100:00100000:2.0:1789065749.330237:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952384:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065749.330245:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 10 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065749.330254:0:8441:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8441:1875971257952512:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065749.330284:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910272 00000100:00100000:3.0:1789065749.330289:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910272 00010000:00010000:3.0:1789065749.330304:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 11 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.330345:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00010000:00010000:2.0:1789065749.330348:0:8441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.330359:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:2348:x1875971235910144:12345-192.168.204.23@tcp:103: 00010000:00010000:3.0:1789065749.330380:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.330387:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 11 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330407:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 11 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330431:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041683200/0x7555615576c825a9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb38 expref: 11 pid: 5831 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330448:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065749.330520:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235910144:12345-192.168.204.23@tcp:103: Request processed in 165us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.330528:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1789065749.330573:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1789065749.330581:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:2347:x1875971235910272:12345-192.168.204.23@tcp:103: 00010000:00010000:3.0:1789065749.330589:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065749.330594:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 9 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330605:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 9 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330617:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fd000/0x7555615576c825a2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb31 expref: 9 pid: 5832 timeout: 308 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330631:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330642:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330674:0:5823:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330682:0:5823:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330690:0:5823:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330698:0:5823:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330706:0:5823:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065749.330712:0:5823:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330723:0:5823:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330736:0:5823:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.330745:0:8441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065749.330748:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065749.330758:0:8441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065749.330766:0:8441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030e00/0x7555615576c825e1 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065749.330777:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f482a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:2347:x1875971235910272:12345-192.168.204.23@tcp:103: Request processed in 196us (717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065749.330785:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00010000:00010000:3.0:1789065749.477713:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065750.501979:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789065750.757718:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789065750.757730:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf081779000 from 39 10000000:01000000:3.0:1789065750.757736:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789065750.757813:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.757838:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.757851:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.757879:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257954432:0@lo:101: 00000100:00100000:3.0:1789065750.757965:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.758053:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050b359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.758279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954432 00000100:00100000:0.0:1789065750.758290:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954432 00000100:00100000:0.0:1789065750.758361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789065750.758372:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+12:5835:x1875971257954432:12345-0@lo:101: 00010000:00010000:0.0:1789065750.758387:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065750.758407:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040030400/0x7555615576c825ef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c825e8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.758432:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030400/0x7555615576c825ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c825e8 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.758443:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040030400/0x7555615576c825ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c825e8 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.758454:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030400, rc 0) 00000100:00100000:0.0:1789065750.758793:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257954432:12345-0@lo:101: Request processed in 422us (828us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.758802:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1789065750.759150:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257954432:0@lo:101: 00010000:00010000:3.0:1789065750.759170:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.759181:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.759248:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257954560:0@lo:501: 00000100:00100000:3.0:1789065750.759290:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.759329:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050b359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.759438:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954560 00000100:00100000:0.0:1789065750.759443:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954560 00000100:00100000:0.0:1789065750.759480:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1789065750.759497:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257954560:12345-0@lo:501: 00000100:00100000:2.0:1789065750.760038:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257954560:0@lo:501: 00000100:00100000:2.0:1789065750.760074:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257954688:0@lo:503: 00000100:00100000:0.0:1789065750.760224:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257954560:12345-0@lo:501: Request processed in 735us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.760232:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789065750.764447:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.764515:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065750.765370:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954688 00000100:00100000:3.0:1789065750.765382:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954688 00000100:00100000:3.0:1789065750.765441:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789065750.765451:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257954688:12345-0@lo:503: 00000100:00100000:3.0:1789065750.765938:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257954688:12345-0@lo:503: Request processed in 487us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.765946:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789065750.766115:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257954688:0@lo:503: 00000100:00100000:1.0:1789065750.771886:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8458:1875971257954816:0@lo:502: 00000100:00100000:1.0:1789065750.771975:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065750.772011:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059480 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.772097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954816 00000100:00100000:0.0:1789065750.772104:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954816 00000100:00100000:0.0:1789065750.772149:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1789065750.772158:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:8458:x1875971257954816:12345-0@lo:502: 00000100:00100000:0.0:1789065750.772407:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:8458:x1875971257954816:12345-0@lo:502: Request processed in 249us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.772414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789065750.772608:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8458:1875971257954816:0@lo:502: 00000100:00100000:1.0:1789065750.772650:0:8458:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8458:1875971257954944:0@lo:502: 00000100:00100000:1.0:1789065750.772675:0:8458:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065750.772706:0:8458:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059480 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.772907:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257954944 00000100:00100000:0.0:1789065750.772912:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257954944 00000100:00100000:0.0:1789065750.772947:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789065750.772953:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:8458:x1875971257954944:12345-0@lo:502: 00000100:00100000:0.0:1789065750.773090:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:8458:x1875971257954944:12345-0@lo:502: Request processed in 137us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.773097:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789065750.773400:0:8458:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8458:1875971257954944:0@lo:502: 00000040:00080000:2.0:1789065750.773422:0:8458:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789065750.773918:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789065750.773940:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789065750.773949:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.773961:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065750.773985:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1789065750.773987:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1789065750.773990:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789065750.774017:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.774025:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.774034:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065750.774054:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955072:0@lo:101: 00000100:00100000:0.0:1789065750.774089:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065750.774123:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.774191:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955072 00000100:00100000:1.0:1789065750.774195:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955072 00000100:00100000:1.0:1789065750.774233:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789065750.774240:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+13:5835:x1875971257955072:12345-0@lo:101: 00010000:00010000:1.0:1789065750.774256:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065750.774393:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073e00/0x7555615576c825fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c825f6 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.774416:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073e00/0x7555615576c825fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c825f6 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.774426:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073e00/0x7555615576c825fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c825f6 expref: 14 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.774434:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073e00, rc 0) 00000100:00100000:1.0:1789065750.774480:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257955072:12345-0@lo:101: Request processed in 241us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.774619:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1789065750.774911:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955072:0@lo:101: 00010000:00010000:0.0:1789065750.774923:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.774932:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065750.774980:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955200:0@lo:501: 00000100:00100000:0.0:1789065750.775004:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065750.775029:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.775077:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955200 00000100:00100000:1.0:1789065750.775082:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955200 00000100:00100000:1.0:1789065750.775142:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789065750.775149:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257955200:12345-0@lo:501: 00000100:00100000:1.0:1789065750.775407:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257955200:12345-0@lo:501: Request processed in 258us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.775414:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1789065750.775472:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955200:0@lo:501: 00000100:00100000:0.0:1789065750.775502:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955328:0@lo:503: 00000100:00100000:0.0:1789065750.775536:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.782014:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955328 00000100:00100000:3.0:1789065750.782031:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955328 00000100:00100000:3.0:1789065750.782085:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1789065750.782097:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257955328:12345-0@lo:503: 00000100:00100000:3.0:1789065750.782451:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257955328:12345-0@lo:503: Request processed in 356us (6913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.782458:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1789065750.788908:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.788950:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955328:0@lo:503: 00000100:00100000:3.0:1789065750.789715:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8459:1875971257955456:0@lo:502: 00000100:00100000:3.0:1789065750.789792:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065750.789964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955456 00000100:00100000:0.0:1789065750.789970:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955456 00000100:00100000:0.0:1789065750.790018:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1789065750.790027:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8459:x1875971257955456:12345-0@lo:502: 00000100:00100000:3.0:1789065750.790352:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050b35000 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.792023:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8459:x1875971257955456:12345-0@lo:502: Request processed in 1988us (2223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.792038:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789065750.794444:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8459:1875971257955456:0@lo:502: 00000020:01000000:2.0:1789065750.794625:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789065750.794638:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065750.794641:0:8459:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789065750.794647:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789065750.794759:0:8459:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8459:1875971257955584:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065750.794896:0:8459:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.794946:0:8459:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.795656:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955584 00000100:00100000:1.0:1789065750.795665:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955584 00000100:00100000:1.0:1789065750.795784:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789065750.795795:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8459:x1875971257955584:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065750.796158:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:8459:x1875971257955584:12345-0@lo:502:llog_process_th.0 Request processed in 364us (1261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.796166:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789065750.799054:0:8459:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8459:1875971257955584:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789065750.799110:0:8459:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065750.799123:0:8459:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065750.799125:0:8459:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789065750.799132:0:8459:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789065750.799398:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789065750.799432:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789065750.799445:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065750.799467:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065750.799479:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789065750.799483:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf07a795800 from 39 10000000:01000000:2.0:1789065750.799494:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789065750.799533:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065750.799542:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065750.799787:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065750.799810:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955712:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.799947:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.799991:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065750.800051:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955712 00000100:00100000:3.0:1789065750.800059:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955712 00000100:00100000:3.0:1789065750.800112:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1789065750.800123:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:5835:x1875971257955712:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065750.800139:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065750.800153:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041683e00/0x7555615576c8260b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82604 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.800178:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041683e00/0x7555615576c8260b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82604 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.800189:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041683e00/0x7555615576c8260b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82604 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.800197:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041683e00, rc 0) 00000100:00100000:3.0:1789065750.800241:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257955712:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.800248:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789065750.800440:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955712:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065750.800453:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065750.800472:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065750.800538:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.800586:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.800657:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.801896:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955840 00000100:00100000:1.0:1789065750.801906:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955840 00000100:00100000:1.0:1789065750.802000:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789065750.802011:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257955840:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065750.802388:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257955840:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 378us (1799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.802396:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789065750.802496:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955840:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.802582:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.802627:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.813931:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065750.816960:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257955968 00000100:00100000:3.0:1789065750.816979:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257955968 00000100:00100000:3.0:1789065750.817043:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1789065750.817052:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257955968:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.817348:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257955968:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 296us (14719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.817356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789065750.819963:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257955968:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.822447:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8460:1875971257956096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065750.822583:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.822628:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065750.822660:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956096 00000100:00100000:3.0:1789065750.822669:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956096 00000100:00100000:3.0:1789065750.822714:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1789065750.822723:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8460:x1875971257956096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065750.822986:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8460:x1875971257956096:12345-0@lo:502:llog_process_th.0 Request processed in 263us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.822994:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789065750.823029:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8460:1875971257956096:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065750.823088:0:8460:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8460:1875971257956224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065750.823126:0:8460:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.823148:0:8460:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.823196:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956224 00000100:00100000:0.0:1789065750.823201:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956224 00000100:00100000:0.0:1789065750.823228:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1789065750.823234:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8460:x1875971257956224:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065750.823405:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:8460:x1875971257956224:12345-0@lo:502:llog_process_th.0 Request processed in 169us (276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.823411:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789065750.823659:0:8460:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8460:1875971257956224:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789065750.823677:0:8460:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789065750.824064:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789065750.824082:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789065750.824093:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.824118:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065750.824127:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1789065750.824130:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1789065750.824133:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789065750.824161:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.824171:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.824181:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065750.824211:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789065750.824246:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065750.824427:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.824668:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956352 00000100:00100000:1.0:1789065750.824674:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956352 00000100:00100000:1.0:1789065750.824782:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789065750.824791:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:5835:x1875971257956352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065750.824801:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065750.824814:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072200/0x7555615576c82619 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82612 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.824836:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072200/0x7555615576c82619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82612 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.824847:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072200/0x7555615576c82619 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82612 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.824855:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072200, rc 0) 00000100:00100000:1.0:1789065750.824896:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257956352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.824902:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789065750.825503:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065750.825520:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065750.825530:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065750.825620:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.825649:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.825669:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.826407:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956480 00000100:00100000:1.0:1789065750.826414:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956480 00000100:00100000:1.0:1789065750.826473:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1789065750.826481:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257956480:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065750.827121:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257956480:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 639us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.827129:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1789065750.838033:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956480:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.838100:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.838183:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.838271:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.840863:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956608 00000100:00100000:0.0:1789065750.840879:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956608 00000100:00100000:0.0:1789065750.840931:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789065750.840938:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257956608:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065750.841205:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257956608:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 266us (3021us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.841212:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789065750.841372:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956608:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065750.843048:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8461:1875971257956736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065750.843139:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065750.843200:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065750.843278:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956736 00000100:00100000:3.0:1789065750.843288:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956736 00000100:00100000:3.0:1789065750.843360:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789065750.843372:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8461:x1875971257956736:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065750.843644:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8461:x1875971257956736:12345-0@lo:502:llog_process_th.0 Request processed in 275us (506us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.843651:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789065750.844313:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8461:1875971257956736:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065750.844357:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065750.844372:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065750.844376:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789065750.844384:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789065750.844420:0:8461:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8461:1875971257956864:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065750.844480:0:8461:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065750.844530:0:8461:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059480 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.845663:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956864 00000100:00100000:0.0:1789065750.845677:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956864 00000100:00100000:0.0:1789065750.845750:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789065750.845773:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8461:x1875971257956864:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065750.846039:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:8461:x1875971257956864:12345-0@lo:502:llog_process_th.0 Request processed in 268us (1558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.846046:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789065750.847017:0:8461:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8461:1875971257956864:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065750.847057:0:8461:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065750.847064:0:8461:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065750.847066:0:8461:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789065750.847071:0:8461:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:3.0:1789065750.847310:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:3.0:1789065750.847330:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789065750.847341:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.847362:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065750.847373:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789065750.847377:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf04c2a4800 from 39 10000000:01000000:3.0:1789065750.847380:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789065750.847410:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.847419:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.847431:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.847462:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.847520:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.847580:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050b359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.848242:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257956992 00000100:00100000:0.0:1789065750.848250:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257956992 00000100:00100000:0.0:1789065750.849958:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789065750.849972:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257956992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065750.849988:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065750.850010:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040031800/0x7555615576c82627 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82620 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.850038:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031800/0x7555615576c82627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82620 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.850049:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040031800/0x7555615576c82627 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82620 expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.850059:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031800, rc 0) 00000100:00100000:0.0:1789065750.850141:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257956992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 172us (2621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.850148:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789065750.851106:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257956992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065750.851131:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065750.851144:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.854034:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.854117:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.854221:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050b359c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.858650:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957120 00000100:00100000:0.0:1789065750.858667:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957120 00000100:00100000:1.0:1789065750.862965:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789065750.862980:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257957120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065750.863358:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257957120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 380us (9239us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.863366:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789065750.863469:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065750.863533:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065750.863614:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.870908:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957248 00000100:00100000:3.0:1789065750.870924:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957248 00000100:00100000:3.0:1789065750.870979:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1789065750.870988:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257957248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065750.871258:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cdf00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065750.871722:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257957248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 734us (8108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.871750:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789065750.871914:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.872473:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8462:1875971257957376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065750.872515:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.872615:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535fd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.872694:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957376 00000100:00100000:0.0:1789065750.872699:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957376 00000100:00100000:0.0:1789065750.872722:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789065750.872727:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8462:x1875971257957376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065750.873023:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8462:x1875971257957376:12345-0@lo:502:llog_process_th.0 Request processed in 295us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.873030:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1789065750.873090:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8462:1875971257957376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065750.873169:0:8462:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8462:1875971257957504:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065750.873197:0:8462:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.873447:0:8462:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535fd900 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.873481:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957504 00000100:00100000:0.0:1789065750.873485:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957504 00000100:00100000:0.0:1789065750.873501:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789065750.873506:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8462:x1875971257957504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065750.873897:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8462:x1875971257957504:12345-0@lo:502:llog_process_th.0 Request processed in 389us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.873904:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789065750.873975:0:8462:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8462:1875971257957504:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1789065750.873996:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789065750.874195:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:3.0:1789065750.874214:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789065750.874224:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.874236:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065750.874456:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1789065750.874459:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:3.0:1789065750.874461:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789065750.874489:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.874497:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.874518:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.874535:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.874657:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.874711:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77180 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.874826:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957632 00000100:00100000:0.0:1789065750.874832:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957632 00000100:00100000:0.0:1789065750.874861:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789065750.874867:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257957632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065750.874878:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065750.874890:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040031c00/0x7555615576c82635 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8262e expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.874911:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031c00/0x7555615576c82635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8262e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.874921:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040031c00/0x7555615576c82635 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8262e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065750.874936:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031c00, rc 0) 00000100:00100000:0.0:1789065750.875009:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257957632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 141us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.875015:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789065750.875063:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065750.875074:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.875083:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.875124:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.875144:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.875477:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77180 going to sleep for 11 seconds 00000100:00100000:2.0:1789065750.882212:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957760 00000100:00100000:2.0:1789065750.882714:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957760 00000100:00100000:3.0:1789065750.882946:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789065750.882982:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257957760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.883393:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257957760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 435us (8246us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065750.883401:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789065750.884132:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.884194:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065750.884247:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.884291:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.884371:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257957888 00000100:00100000:1.0:1789065750.884378:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257957888 00000100:00100000:1.0:1789065750.884438:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789065750.884445:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257957888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065750.884945:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257957888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 498us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.884953:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1789065750.885032:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257957888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065750.885402:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8463:1875971257958016:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065750.885440:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065750.885825:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609c300 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.885898:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958016 00000100:00100000:0.0:1789065750.885904:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958016 00000100:00100000:0.0:1789065750.885943:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789065750.885951:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8463:x1875971257958016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065750.886348:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8463:x1875971257958016:12345-0@lo:502:llog_process_th.0 Request processed in 396us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.886356:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789065750.887057:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8463:1875971257958016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789065750.887106:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789065750.887139:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065750.887142:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789065750.887149:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789065750.887183:0:8463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8463:1875971257958144:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065750.887232:0:8463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065750.887364:0:8463:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789065750.887402:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958144 00000100:00100000:0.0:1789065750.887408:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958144 00000100:00100000:0.0:1789065750.887616:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1789065750.887627:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8463:x1875971257958144:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065750.887971:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8463:x1875971257958144:12345-0@lo:502:llog_process_th.0 Request processed in 346us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065750.887979:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789065750.888091:0:8463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8463:1875971257958144:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789065750.888138:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065750.888143:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065750.888145:0:8463:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789065750.888149:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789065750.888661:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789065750.888691:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789065750.888703:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.888728:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065750.888738:0:5835:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789065750.888741:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf0581e4d40 from 1 10000000:01000000:3.0:1789065750.888743:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789065750.888778:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.888787:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.888798:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.888821:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257958272:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.888861:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.889177:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77240 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.889245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958272 00000100:00100000:1.0:1789065750.889251:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958272 00000100:00100000:1.0:1789065750.889291:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789065750.889309:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257958272:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065750.889321:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065750.889333:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073600/0x7555615576c82643 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8263c expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.889355:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073600/0x7555615576c82643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8263c expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.889365:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073600/0x7555615576c82643 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8263c expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065750.889394:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073600, rc 0) 00000100:00100000:1.0:1789065750.889436:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257958272:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065750.889443:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789065750.889690:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257958272:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065750.889703:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.889711:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065750.889786:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257958400:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.889842:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065750.889866:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77240 going to sleep for 11 seconds 00000100:00100000:1.0:1789065750.890055:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958400 00000100:00100000:1.0:1789065750.890074:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958400 00000100:00100000:1.0:1789065750.890107:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789065750.890130:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257958400:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065750.891003:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257958400:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 888us (1158us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789065750.891013:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789065750.891054:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257958400:0@lo:501:ll_cfg_requeue.0 10000000:01000000:3.0:1789065750.891089:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789065750.891099:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065750.891110:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065751.525766:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065751.717494:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065751.717705:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910400 00000100:00100000:3.0:1789065751.717715:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910400 00000100:00100000:3.0:1789065751.717769:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:3.0:1789065751.717780:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:5595:x1875971235910400:12345-192.168.204.23@tcp:101: 00010000:00010000:3.0:1789065751.717795:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:0.0:1789065751.717810:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1789065751.717813:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041682000/0x7555615576c8264a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdb9a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065751.717828:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257958528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789065751.717843:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041682000/0x7555615576c8264a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb9a expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065751.717855:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041682000/0x7555615576c8264a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb9a expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065751.717877:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041682000, rc 0) 00000100:00100000:0.0:1789065751.717879:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065751.717932:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235910400:12345-192.168.204.23@tcp:101: Request processed in 154us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065751.717954:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:2.0:1789065751.717957:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958528 00000100:00100000:2.0:1789065751.717964:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958528 00000100:00100000:2.0:1789065751.718011:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789065751.718020:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257958528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065751.718049:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789065751.718438:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789065751.727401:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065751.727662:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910528 00000100:00100000:3.0:1789065751.727737:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910528 00000100:00100000:3.0:1789065751.727796:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:3.0:1789065751.727806:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235910528:12345-192.168.204.23@tcp:501: 00000100:00100000:3.0:1789065751.728847:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235910528:12345-192.168.204.23@tcp:501: Request processed in 1037us (1450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065751.728857:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:2.0:1789065751.733101:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257958528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15071us (15211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065751.733116:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:0.0:1789065751.733427:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd20380 x1875971257958528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065751.734728:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257958528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065751.736668:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065751.737053:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910656 00000100:00100000:0.0:1789065751.737061:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910656 00000100:00100000:0.0:1789065751.737114:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1789065751.737123:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235910656:12345-192.168.204.23@tcp:503: 00000100:00100000:0.0:1789065751.737348:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235910656:12345-192.168.204.23@tcp:503: Request processed in 225us (686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065751.737356:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:1.0:1789065751.755107:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065751.755322:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910784 00000100:00100000:3.0:1789065751.755332:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910784 00000100:00100000:3.0:1789065751.755382:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:3.0:1789065751.755391:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:6072:x1875971235910784:12345-192.168.204.23@tcp:502: 00000100:00100000:3.0:1789065751.756076:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:6072:x1875971235910784:12345-192.168.204.23@tcp:502: Request processed in 682us (976us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065751.756086:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:3.0:1789065751.765883:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065751.766973:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235910912 00000100:00100000:1.0:1789065751.766988:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235910912 00000100:00100000:1.0:1789065751.767113:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:1.0:1789065751.767125:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:6072:x1875971235910912:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789065751.768835:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:6072:x1875971235910912:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 1702us (2953us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065751.768847:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:2.0:1789065751.772972:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065751.773373:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911040 00000100:00100000:3.0:1789065751.773382:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911040 00000100:00100000:3.0:1789065751.773439:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:3.0:1789065751.773454:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235911040:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065751.773469:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065751.773487:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041682e00/0x7555615576c82651 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdba1 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065751.773517:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041682e00/0x7555615576c82651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba1 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065751.773736:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041682e00/0x7555615576c82651 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba1 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065751.773747:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041682e00, rc 0) 00000100:00100000:3.0:1789065751.773800:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235911040:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 348us (837us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065751.773808:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:2.0:1789065751.790105:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065751.790248:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911168 00000100:00100000:1.0:1789065751.790259:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911168 00000100:00100000:1.0:1789065751.790347:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:1.0:1789065751.790355:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235911168:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065751.790689:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235911168:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 332us (598us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789065751.790699:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 171 00010000:00010000:3.0:1789065752.549853:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065752.741865:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257958912:0@lo:400:kworker.0 00000100:00100000:1.0:1789065752.741932:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065752.741996:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789065752.742003:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257958784:0@lo:400:kworker.0 00000100:00100000:1.0:1789065752.742025:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065752.742055:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257959296:0@lo:400:kworker.0 00000100:00100000:1.0:1789065752.742080:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065752.742242:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257958656:0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.742288:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065752.742320:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257959168:0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.742341:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065752.742361:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789065752.742366:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257959040:0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.742386:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065752.742413:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958912 00000100:00100000:0.0:1789065752.742422:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958912 00000100:00100000:0.0:1789065752.742467:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958784 00000100:00100000:0.0:1789065752.742471:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958784 00000100:00100000:0.0:1789065752.742483:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959168 00000100:00100000:0.0:1789065752.742485:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959168 00000100:00100000:0.0:1789065752.742500:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065752.742508:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257958912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.742579:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257958912:12345-0@lo:400:kworker.0 Request processed in 70us (647us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065752.742587:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065752.742605:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789065752.742610:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257958784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.742650:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257958784:12345-0@lo:400:kworker.0 Request processed in 39us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065752.742656:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789065752.742667:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789065752.742672:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257959168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.742701:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257959168:12345-0@lo:400:kworker.0 Request processed in 28us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065752.742706:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789065752.742741:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257959168:0@lo:400:kworker.0 00000100:00100000:1.0:1789065752.742828:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257958656 00000100:00100000:1.0:1789065752.742833:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257958656 00000100:00100000:1.0:1789065752.742871:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1789065752.742878:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257958656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065752.742911:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257958656:12345-0@lo:400:kworker.0 Request processed in 34us (622us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065752.742917:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:1.0:1789065752.742942:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065752.742960:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257958784:0@lo:400:kworker.0 00000100:00100000:1.0:1789065752.742971:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257958912:0@lo:400:kworker.0 00000100:00100000:3.0:1789065752.743107:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959296 00000100:00100000:3.0:1789065752.743111:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959296 00000100:00100000:3.0:1789065752.743152:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959040 00000100:00100000:3.0:1789065752.743155:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959040 00000100:00100000:3.0:1789065752.743176:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789065752.743182:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257959296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065752.743220:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257959296:12345-0@lo:400:kworker.0 Request processed in 38us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065752.743226:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789065752.743239:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789065752.743246:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257959040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065752.743287:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257959040:12345-0@lo:400:kworker.0 Request processed in 41us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065752.743293:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:1.0:1789065752.743876:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789065752.743903:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edd3800 x1875971257959296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065752.743915:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257959296:0@lo:400:kworker.0 00000100:00100000:2.0:1789065752.744066:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065752.744078:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257959424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065752.744115:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065752.744572:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959424 00000100:00100000:3.0:1789065752.744579:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959424 00000100:00100000:3.0:1789065752.744622:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789065752.744630:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257959424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789065752.744672:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065752.744725:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257959424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065752.744731:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789065752.744873:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e63b80 x1875971257959424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065768 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065752.744889:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257959424:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1789065752.745346:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f480380 x1875971257959040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065768 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065752.745357:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257959040:0@lo:400:kworker.0 00000100:00100000:0.0:1789065752.745368:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257958656:0@lo:400:kworker.0 00000100:00100000:1.0:1789065753.510232:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065753.510276:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065753.510301:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065753.510323:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065753.510346:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911424 00000100:00100000:1.0:1789065753.510353:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911424 00000100:00100000:1.0:1789065753.510409:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1789065753.510419:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235911424:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065753.510484:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235911424:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 67us (182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065753.510491:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00080000:1.0:1789065753.510511:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065753.510630:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911296 00000100:00100000:2.0:1789065753.510634:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911296 00000100:00100000:2.0:1789065753.510663:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:2.0:1789065753.510670:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235911296:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065753.510703:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235911296:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 33us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065753.510710:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:3.0:1789065753.511650:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911552 00000100:00100000:3.0:1789065753.511658:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911552 00000100:00100000:3.0:1789065753.511717:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911680 00000100:00100000:3.0:1789065753.511720:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911680 00000100:00100000:3.0:1789065753.511746:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1789065753.511755:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235911552:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065753.511804:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235911552:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 50us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065753.511810:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1789065753.511823:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1789065753.511829:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235911680:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065753.511851:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235911680:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 23us (1527us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065753.511856:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00080000:0.0:1789065753.512389:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789065753.512393:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789065753.573909:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789065753.781799:0:8503:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd42aad500 20000000:00000080:2.0:1789065753.781819:0:8503:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf07ece5000 uarg=0000000000000000 20000000:01000000:2.0:1789065753.781864:0:8503:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789065753.781871:0:8503:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789065753.781875:0:8503:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789065753.782885:0:8504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789065753.782990:0:8503:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1789065753.790917:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1789065753.790971:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1789065753.791024:0:8503:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1789065753.791040:0:8503:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789065753.791058:0:8503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791076:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c823c6 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791085:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82428 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791092:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c824f3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791102:0:8503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791109:0:8503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791158:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 9 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.791172:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 9 pid: 5832 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065753.791186:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959552:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065753.794504:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c824f3 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.794523:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c824f3 expref: 18 pid: 5832 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065753.794540:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959680:0@lo:104: 00000100:00100000:2.0:1789065753.794627:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789065753.794679:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82428 expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.794687:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82428 expref: 18 pid: 5831 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065753.794695:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959808:0@lo:104: 00000100:00100000:2.0:1789065753.794718:0:8503:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789065753.794746:0:8503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c823c6 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.794754:0:8503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c823c6 expref: 18 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065753.794782:0:8503:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959936:0@lo:104: 00000100:00100000:2.0:1789065753.794803:0:8503:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdc00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065753.796327:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789065753.796362:0:5821:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065753.796382:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959680 00000100:00100000:0.0:1789065753.796390:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959680 00000100:00100000:0.0:1789065753.796430:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959808 00000100:00100000:0.0:1789065753.796433:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959808 00000100:00100000:0.0:1789065753.796443:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257959936 00000100:00100000:0.0:1789065753.796446:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257959936 00000100:00100000:0.0:1789065753.796458:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789065753.796466:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:8503:x1875971257959680:12345-0@lo:104: 00010000:00010000:0.0:1789065753.796493:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.796586:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065753.796592:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:8503:x1875971257959680:12345-0@lo:104: Request processed in 127us (1966us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065753.796599:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789065753.796618:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789065753.796624:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081781050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:8503:x1875971257959808:12345-0@lo:104: 00010000:00010000:0.0:1789065753.796631:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.796661:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789065753.796666:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081781050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:8503:x1875971257959808:12345-0@lo:104: Request processed in 43us (1948us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065753.796671:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789065753.796703:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789065753.796709:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:8503:x1875971257959936:12345-0@lo:104: 00010000:00010000:0.0:1789065753.796716:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.796747:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789065753.796752:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:8503:x1875971257959936:12345-0@lo:104: Request processed in 44us (391us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065753.796758:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789065753.796774:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789065753.796779:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.796791:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065753.796796:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.796804:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065753.796922:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959680:0@lo:104: 00000100:00100000:2.0:1789065753.796931:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc94000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959808:0@lo:104: 00000100:00100000:2.0:1789065753.796938:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959936:0@lo:104: 10000000:00010000:0.0:1789065753.797453:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065753.797459:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065753.797507:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.797515:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1789065753.797710:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:0.0:1789065753.797732:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.797740:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821fec00/0x7555615576c824f3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c824fa expref: -99 pid: 7619 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.797754:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789065753.797758:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.797764:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072600 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065753.797767:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.797787:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065753.797793:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065753.797798:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065753.798269:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.798277:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065753.799619:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065753.799629:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.799639:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fee00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065753.799642:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.799651:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065753.799658:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065753.799664:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789065753.799708:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.799714:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789065753.799730:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.799741:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821fee00/0x7555615576c823c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c823cd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.799768:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065753.799769:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065753.799771:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065753.799936:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257960320:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789065753.799995:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065753.800107:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960320 00000100:00100000:2.0:1789065753.800114:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960320 00010000:00010000:2.0:1789065753.800147:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c823c6 expref: 19 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065753.800183:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789065753.800191:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257960320:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789065753.800204:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065753.800208:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c823c6 expref: 19 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.800228:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c823c6 expref: 19 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.800254:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fc000/0x7555615576c823cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c823c6 expref: 19 pid: 5833 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065753.800268:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065753.800300:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3295:x1875971257960320:12345-0@lo:103:ldlm_bl.0 Request processed in 110us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065753.800307:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789065753.800468:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257960320:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789065753.801145:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257960192:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789065753.801186:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065753.801225:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257960064:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789065753.801273:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065753.801388:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960192 00000100:00100000:3.0:1789065753.801394:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960192 00010000:00010000:3.0:1789065753.801419:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82428 expref: 18 pid: 5831 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065753.801445:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960064 00000100:00100000:3.0:1789065753.801448:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960064 00010000:00010000:3.0:1789065753.801458:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c824f3 expref: 19 pid: 5832 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065753.801483:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789065753.801490:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257960192:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789065753.801501:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065753.801507:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82428 expref: 19 pid: 5831 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065753.801515:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82428 expref: 19 pid: 5831 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065753.801530:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072400/0x7555615576c8242f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82428 expref: 19 pid: 5831 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065753.801577:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065753.801614:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3298:x1875971257960192:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065753.801621:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789065753.801636:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789065753.801642:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3298:x1875971257960064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789065753.801650:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065753.801654:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c824f3 expref: 17 pid: 5832 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065753.801661:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c824f3 expref: 17 pid: 5832 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065753.801670:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072a00/0x7555615576c824fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c824f3 expref: 17 pid: 5832 timeout: 362 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065753.801689:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065753.801711:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3298:x1875971257960064:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065753.801718:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789065753.801748:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257960192:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789065753.801757:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257960064:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065753.802508:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.802520:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf06b072600/0x7555615576c82428 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8242f expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.803449:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065753.803493:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065753.803496:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065753.803497:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065753.808682:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065753.808761:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911808 00000100:00100000:1.0:1789065753.808773:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911808 00010000:00010000:1.0:1789065753.808813:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 10 pid: 5832 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065753.808856:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:1.0:1789065753.808868:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235911808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065753.808884:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065753.808890:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 10 pid: 5832 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808905:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 10 pid: 5832 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808927:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808936:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808968:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808975:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808982:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808989:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.808995:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065753.809000:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.809008:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.809016:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065753.809027:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065753.809080:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235911808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 214us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065753.809088:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00010000:00010000:0.0:1789065753.809620:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073a00/0x7555615576c825b7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb69 expref: 9 pid: 5832 timeout: 312 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065753.809638:0:8503:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8503:1875971257959552:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065753.809667:0:8503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.809676:0:8503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.809694:0:8503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065753.809700:0:8503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1d800/0x7555615576c82658 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065754.597743:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065755.637467:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065755.748704:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 10000000:01000000:1.0:1789065755.749868:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789065755.749877:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf081779000 from 4 10000000:01000000:1.0:1789065755.749882:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789065755.749964:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.749978:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.749993:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065755.750023:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257960448:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789065755.750110:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065755.760834:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77600 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.765693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235911936 00000100:00100000:0.0:1789065755.765713:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235911936 00000100:00100000:1.0:1789065755.765903:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960448 00000100:00100000:1.0:1789065755.765907:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960448 00000100:00100000:1.0:1789065755.765935:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 174 00000100:00100000:1.0:1789065755.765947:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:5595:x1875971235911936:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065755.765969:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065755.765997:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdba8 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766035:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766049:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 10 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766060:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073800, rc 0) 00000100:00100000:1.0:1789065755.766164:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235911936:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 219us (17475us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065755.766194:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 174 00000100:00100000:1.0:1789065755.766247:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789065755.766254:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257960448:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065755.766261:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065755.766270:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8265f expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766287:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8265f expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766295:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8265f expref: 17 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766301:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072800, rc 0) 00000100:00100000:1.0:1789065755.766645:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257960448:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 391us (16534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065755.766653:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789065755.766853:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257960448:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065755.766875:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.766885:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065755.766971:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257960576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065755.767003:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065755.767045:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77600 going to sleep for 11 seconds 00000100:00100000:1.0:1789065755.767060:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960576 00000100:00100000:1.0:1789065755.767065:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960576 00000100:00100000:1.0:1789065755.767085:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1789065755.767091:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257960576:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065755.767824:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257960576:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 728us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065755.767833:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789065755.769492:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257960576:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.769645:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257960704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.769749:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.769800:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.769830:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960704 00000100:00100000:0.0:1789065755.769839:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960704 00000100:00100000:0.0:1789065755.769902:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789065755.769913:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257960704:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.770161:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257960704:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 249us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065755.772524:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065755.772612:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912064 00000100:00100000:3.0:1789065755.772623:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912064 00000100:00100000:0.0:1789065755.772785:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789065755.772895:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257960704:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065755.777152:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8553:1875971257960832:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065755.777281:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065755.777458:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789065755.779301:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960832 00000100:00100000:2.0:1789065755.779336:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960832 00000100:00100000:3.0:1789065755.780740:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:3.0:1789065755.780765:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235912064:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065755.783821:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235912064:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 3049us (11294us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065755.783844:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:2.0:1789065755.795127:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1789065755.795151:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8553:x1875971257960832:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065755.795525:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8553:x1875971257960832:12345-0@lo:502:llog_process_th.0 Request processed in 382us (18243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065755.795535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:1.0:1789065755.796621:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8553:1875971257960832:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065755.796678:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065755.796692:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065755.796696:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789065755.796707:0:8553:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf081779000 00000020:00000080:1.0:1789065755.796710:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789065755.796825:0:8553:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8553:1875971257960960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065755.796892:0:8553:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065755.796938:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257960960 00000100:00100000:1.0:1789065755.796946:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257960960 00000100:00100000:1.0:1789065755.796996:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789065755.797005:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8553:x1875971257960960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065755.797256:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:8553:x1875971257960960:12345-0@lo:502:llog_process_th.0 Request processed in 251us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065755.797264:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789065755.798276:0:8553:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065755.798886:0:8553:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8553:1875971257960960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065755.798939:0:8553:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065755.798949:0:8553:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065755.798951:0:8553:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789065755.798959:0:8553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789065755.806228:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789065755.806281:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789065755.806296:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.806320:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065755.806346:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789065755.806349:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07a795800 from 4 10000000:01000000:0.0:1789065755.806352:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789065755.806403:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.806411:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.806424:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065755.806458:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961088:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.806597:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.806656:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.806687:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961088 00000100:00100000:0.0:1789065755.806696:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961088 00000100:00100000:0.0:1789065755.806754:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789065755.806764:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257961088:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065755.806781:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065755.806797:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82674 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.806825:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82674 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.806838:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82674 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.806859:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031a00, rc 0) 00000100:00100000:0.0:1789065755.806908:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257961088:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.806916:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1789065755.806979:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961088:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065755.806996:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.807006:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065755.807065:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.807092:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.807107:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.807118:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961216 00000100:00100000:0.0:1789065755.807123:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961216 00000100:00100000:0.0:1789065755.807144:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789065755.807150:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257961216:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.807459:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257961216:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.807467:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789065755.807498:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961216:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.807528:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.807595:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.807617:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.807628:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961344 00000100:00100000:0.0:1789065755.807632:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961344 00000100:00100000:0.0:1789065755.807652:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789065755.807658:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257961344:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.807814:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257961344:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 155us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.807821:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1789065755.807863:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961344:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.808089:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8555:1875971257961472:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065755.808122:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.808142:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961472 00000100:00100000:0.0:1789065755.808146:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961472 00000100:00100000:0.0:1789065755.808168:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789065755.808174:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8555:x1875971257961472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065755.808326:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8555:x1875971257961472:12345-0@lo:502:llog_process_th.0 Request processed in 151us (203us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.808333:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789065755.808361:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da780 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.808373:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8555:1875971257961472:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789065755.808398:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789065755.808410:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065755.808413:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789065755.808421:0:8555:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf07a795800 00000020:00000080:0.0:1789065755.808424:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789065755.808510:0:8555:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8555:1875971257961600:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065755.808575:0:8555:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.808596:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961600 00000100:00100000:0.0:1789065755.808599:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961600 00000100:00100000:0.0:1789065755.808620:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789065755.808626:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8555:x1875971257961600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065755.808732:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:8555:x1875971257961600:12345-0@lo:502:llog_process_th.0 Request processed in 105us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.808739:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789065755.808768:0:8555:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.808781:0:8555:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8555:1875971257961600:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789065755.808800:0:8555:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065755.808803:0:8555:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065755.808805:0:8555:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789065755.808809:0:8555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789065755.808865:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789065755.808886:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789065755.808896:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.808906:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065755.808918:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789065755.808921:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf04c2a4800 from 4 10000000:01000000:0.0:1789065755.808924:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789065755.808950:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.808958:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.808976:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065755.808990:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961728:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.818276:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.818469:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.818503:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961728 00000100:00100000:0.0:1789065755.818514:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961728 00000100:00100000:0.0:1789065755.818592:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789065755.818605:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257961728:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065755.818627:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065755.818651:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82682 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.818686:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82682 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.818699:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82682 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.818710:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030a00, rc 0) 00000100:00100000:0.0:1789065755.818784:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257961728:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (521us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.818792:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789065755.818863:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961728:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065755.818883:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065755.818903:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065755.818990:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.819024:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.819055:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065755.819097:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961856 00000100:00100000:3.0:1789065755.819113:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961856 00000100:00100000:1.0:1789065755.819496:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065755.830186:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912192 00000100:00100000:3.0:1789065755.830212:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912192 00000100:00100000:3.0:1789065755.830277:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789065755.830289:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257961856:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065755.830678:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257961856:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 390us (11651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065755.830686:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1789065755.830731:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:3.0:1789065755.830749:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235912192:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065755.831065:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:5595:x1875971235912192:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 325us (11572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065755.831072:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:3.0:1789065755.836577:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065755.836617:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912320 00000100:00100000:3.0:1789065755.836627:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912320 00000100:00100000:3.0:1789065755.836670:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:3.0:1789065755.836680:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:6131:x1875971235912320:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789065755.836973:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:6131:x1875971235912320:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 293us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065755.836993:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:0.0:1789065755.837459:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961856:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.837536:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.837639:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.837684:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609ccc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065755.837715:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257961984 00000100:00100000:0.0:1789065755.837722:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257961984 00000100:00100000:0.0:1789065755.837764:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789065755.837773:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257961984:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.837972:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257961984:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 200us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.837980:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1789065755.838032:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257961984:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065755.842766:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8558:1875971257962112:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065755.842885:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065755.842934:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962112 00000100:00100000:0.0:1789065755.842943:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962112 00000100:00100000:0.0:1789065755.843006:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:0.0:1789065755.843018:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:8558:x1875971257962112:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065755.844859:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065755.852144:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:8558:x1875971257962112:12345-0@lo:502:llog_process_th.0 Request processed in 9118us (9249us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065755.852159:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1789065755.852263:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8558:1875971257962112:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065755.852300:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065755.852309:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065755.852312:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789065755.852321:0:8558:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf04c2a4800 00000020:00000080:1.0:1789065755.852323:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789065755.852419:0:8558:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8558:1875971257962240:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065755.852475:0:8558:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065755.852507:0:8558:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050b35600 going to sleep for 11 seconds 00000100:00100000:1.0:1789065755.852538:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962240 00000100:00100000:1.0:1789065755.852544:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962240 00000100:00100000:1.0:1789065755.852611:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789065755.852620:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:8558:x1875971257962240:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065755.852756:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:8558:x1875971257962240:12345-0@lo:502:llog_process_th.0 Request processed in 137us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065755.852763:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:1.0:1789065755.852813:0:8558:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:8558:1875971257962240:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065755.852842:0:8558:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065755.852846:0:8558:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065755.852848:0:8558:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789065755.852853:0:8558:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1789065755.853477:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1789065755.853500:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789065755.853520:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065755.853533:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065755.863164:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065755.865377:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912448 00000100:00100000:0.0:1789065755.865393:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912448 00000100:00100000:0.0:1789065755.865463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 193 00000100:00100000:0.0:1789065755.865476:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:6131:x1875971235912448:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789065755.866178:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:6131:x1875971235912448:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 703us (3020us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065755.868002:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 193 00010000:00010000:2.0:1789065756.648889:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065756.837863:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065756.851076:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257962368:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065756.851223:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065756.853472:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962368 00000100:00100000:1.0:1789065756.853493:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962368 00000100:00100000:0.0:1789065756.863425:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789065756.863445:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257962368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065756.863508:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065756.864615:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257962368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1168us (13385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065756.864630:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:1.0:1789065756.865293:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789065756.873433:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd20000 x1875971257962368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065756.873473:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257962368:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789065757.670909:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065757.863264:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257962496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065757.863365:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065757.863519:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962496 00000100:00100000:3.0:1789065757.863531:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962496 00000100:00100000:3.0:1789065757.863644:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789065757.863656:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257962496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789065757.863707:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065757.863762:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257962496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065757.863802:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789065757.863877:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789065757.863914:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e61880 x1875971257962496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065773 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065757.863937:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257962496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065757.874633:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789065757.874666:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257962752:0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.874757:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065757.874837:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962752 00000100:00100000:2.0:1789065757.874847:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962752 00000100:00100000:2.0:1789065757.874908:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789065757.874918:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257962752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.874978:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257962752:12345-0@lo:400:kworker.0 Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065757.875004:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789065757.875060:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257962752:0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.875098:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257962880:0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.875122:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065757.875176:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962880 00000100:00100000:2.0:1789065757.875181:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962880 00000100:00100000:2.0:1789065757.875219:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789065757.875226:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257962880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.875261:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257962880:12345-0@lo:400:kworker.0 Request processed in 36us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065757.875267:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:2.0:1789065757.875287:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065757.875307:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257962880:0@lo:400:kworker.0 00000100:00100000:3.0:1789065757.875495:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257963008:0@lo:400:kworker.0 00000100:00100000:3.0:1789065757.875533:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065757.875588:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789065757.875595:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257962624:0@lo:400:kworker.0 00000100:00100000:3.0:1789065757.875626:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065757.875645:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257963136:0@lo:400:kworker.0 00000100:00100000:3.0:1789065757.875665:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065757.875808:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963008 00000100:00100000:2.0:1789065757.875813:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963008 00000100:00100000:2.0:1789065757.875847:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789065757.875854:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257963008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065757.875964:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257962624 00000100:00100000:1.0:1789065757.875969:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257962624 00000100:00100000:1.0:1789065757.875996:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1789065757.876002:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257962624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.876052:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257963008:12345-0@lo:400:kworker.0 Request processed in 198us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065757.876059:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789065757.876074:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963136 00000100:00100000:2.0:1789065757.876077:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963136 00000100:00100000:2.0:1789065757.876101:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789065757.876106:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257963136:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789065757.879040:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065757.879663:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257962624:12345-0@lo:400:kworker.0 Request processed in 3652us (4028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065757.879682:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1789065757.881620:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257963136:12345-0@lo:400:kworker.0 Request processed in 5506us (5947us total) trans 0 rc 0/0 00010000:00080000:0.0:1789065757.881620:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fc96300 x1875971257963008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065773 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065757.881644:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257963008:0@lo:400:kworker.0 00000100:00100000:2.0:1789065757.881656:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789065757.881688:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257962624:0@lo:400:kworker.0 00000100:00100000:0.0:1789065757.881701:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257963136:0@lo:400:kworker.0 00000100:00100000:1.0:1789065758.633079:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065758.634105:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912576 00000100:00100000:0.0:1789065758.634132:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912576 00000100:00100000:0.0:1789065758.634224:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:0.0:1789065758.634237:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2347:x1875971235912576:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065758.634342:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2347:x1875971235912576:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (1284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065758.634368:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:0.0:1789065758.654534:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065758.654676:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065758.654729:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065758.654966:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912960 00000100:00100000:1.0:1789065758.654981:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912960 00000100:00100000:1.0:1789065758.655066:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912832 00000100:00100000:1.0:1789065758.655069:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912832 00000100:00100000:1.0:1789065758.655100:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:1.0:1789065758.655113:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235912960:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065758.655253:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235912960:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 142us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065758.655261:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:1.0:1789065758.655284:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:1.0:1789065758.655291:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235912832:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065758.655332:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235912832:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 41us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065758.655339:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00080000:0.0:1789065758.655463:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789065758.655469:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789065758.657398:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235912704 00000100:00100000:2.0:1789065758.657417:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235912704 00000100:00100000:2.0:1789065758.657542:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:2.0:1789065758.657591:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235912704:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065758.657701:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235912704:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 113us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065758.657709:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00080000:0.0:1789065758.658456:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789065758.693808:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065759.722272:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065760.745593:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065761.769516:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065761.962502:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257963264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065761.962609:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065761.962714:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963264 00000100:00100000:1.0:1789065761.962724:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963264 00000100:00100000:1.0:1789065761.962802:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789065761.962814:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257963264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789065761.962874:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065761.962939:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257963264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065761.962946:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:1.0:1789065761.962975:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789065761.963018:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf0818db800 x1875971257963264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065761.963041:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257963264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065762.789895:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065762.989937:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257963520:0@lo:400:kworker.0 00000100:00100000:0.0:1789065762.990057:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065762.990301:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257964032:0@lo:400:kworker.0 00000100:00100000:0.0:1789065762.990335:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065762.990379:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065762.990386:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257963648:0@lo:400:kworker.0 00000100:00100000:0.0:1789065762.990410:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065762.991148:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963520 00000100:00100000:3.0:1789065762.991162:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963520 00000100:00100000:3.0:1789065762.991236:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963648 00000100:00100000:3.0:1789065762.991240:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963648 00000100:00100000:3.0:1789065762.991284:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789065762.991297:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257963520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065762.991404:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257963520:12345-0@lo:400:kworker.0 Request processed in 111us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065762.991412:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789065762.991432:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789065762.991438:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257963648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065762.991823:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257963520:0@lo:400:kworker.0 00000100:00100000:3.0:1789065762.993426:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257963648:12345-0@lo:400:kworker.0 Request processed in 1975us (3001us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065762.993444:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789065762.996188:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257963648:0@lo:400:kworker.0 00000100:00100000:1.0:1789065762.998705:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257963776:0@lo:400:kworker.0 00000100:00100000:1.0:1789065762.998824:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065762.998918:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789065762.998927:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257963392:0@lo:400:kworker.0 00000100:00100000:1.0:1789065762.998966:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065762.999212:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257963904:0@lo:400:kworker.0 00000100:00100000:1.0:1789065762.999247:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065762.999304:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964032 00000100:00100000:1.0:1789065762.999315:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964032 00000100:00100000:1.0:1789065762.999384:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963776 00000100:00100000:1.0:1789065762.999388:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963776 00000100:00100000:1.0:1789065762.999418:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789065762.999428:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257964032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065763.000792:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257964032:12345-0@lo:400:kworker.0 Request processed in 1355us (10447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.000808:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789065763.000846:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789065763.000864:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257963776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065763.000913:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257963776:12345-0@lo:400:kworker.0 Request processed in 59us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.000920:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789065763.000947:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789065763.000952:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789065763.000956:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065763.000970:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963904 00010000:00080000:3.0:1789065763.002201:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e61880 x1875971257964032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065763.002256:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257964032:0@lo:400:kworker.0 00000100:00100000:1.0:1789065763.006766:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963904 00000100:00100000:1.0:1789065763.006894:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789065763.006907:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257963904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065763.008859:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065763.008887:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257964160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065763.009099:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818db800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257963904:12345-0@lo:400:kworker.0 Request processed in 2193us (9848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.009136:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789065763.009302:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257963392 00000100:00100000:1.0:1789065763.009313:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257963392 00000100:00100000:1.0:1789065763.009362:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:1.0:1789065763.009372:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257963392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065763.009427:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257963392:12345-0@lo:400:kworker.0 Request processed in 57us (10461us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.009434:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789065763.009700:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789065763.021420:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065763.021509:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257963392:0@lo:400:kworker.0 00000100:00100000:2.0:1789065763.021536:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257963904:0@lo:400:kworker.0 00010000:00080000:2.0:1789065763.021595:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e61c00 x1875971257963776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065778 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065763.021610:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257963776:0@lo:400:kworker.0 00000100:00100000:2.0:1789065763.021901:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964160 00000100:00100000:2.0:1789065763.021911:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964160 00000100:00100000:2.0:1789065763.023723:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789065763.023745:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257964160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065763.023802:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065763.023911:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257964160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 174us (14212us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065763.023929:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:2.0:1789065763.024204:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e61880 x1875971257964160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065763.024231:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257964160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065763.760506:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065763.760617:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065763.760678:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913088 00000100:00100000:1.0:1789065763.760691:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913088 00000100:00100000:1.0:1789065763.760756:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00100000:1.0:1789065763.760769:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2347:x1875971235913088:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065763.760867:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2347:x1875971235913088:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 100us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.760876:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00100000:1.0:1789065763.760921:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913216 00000100:00100000:1.0:1789065763.760926:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913216 00000100:00100000:1.0:1789065763.760981:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:1.0:1789065763.760989:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235913216:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065763.761026:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235913216:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 37us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.761033:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00080000:1.0:1789065763.761090:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065763.776405:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065763.776465:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065763.778490:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913344 00000100:00100000:0.0:1789065763.778512:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913344 00000100:00100000:0.0:1789065763.778634:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913472 00000100:00100000:0.0:1789065763.778639:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913472 00000100:00100000:0.0:1789065763.778676:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1789065763.778689:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2346:x1875971235913344:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:0.0:1789065763.778741:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c825c5 00000100:00080000:0.0:1789065763.778753:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9cf044fd9000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789065763.780694:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789065763.780707:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789065763.780720:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065763.781671:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1789065763.781701:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2346:x1875971235913472:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:3.0:1789065763.781744:0:6880:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c825cc 00000100:00080000:3.0:1789065763.781757:0:6880:0:(import.c:65:import_set_state_nolock()) ffff9cf081646000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789065763.781807:0:6880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000001:00000004:0.0:1789065763.782123:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789065763.782265:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+2:2346:x1875971235913472:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 578us (5796us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065763.782273:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00010000:00010000:3.0:1789065763.782876:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065763.784664:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+2:2346:x1875971235913344:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 5961us (8269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065763.784686:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00010000:00010000:3.0:1789065763.815131:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789065764.335592:0:8804:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1789065764.838433:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065765.864022:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065766.885716:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065767.078041:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789065767.078064:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257964288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065767.078130:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065767.079071:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964288 00000100:00100000:1.0:1789065767.079083:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964288 00000100:00100000:1.0:1789065767.079159:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789065767.079170:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257964288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789065767.079255:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065767.079490:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257964288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 321us (1358us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065767.079499:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789065767.080808:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf08176aa00 x1875971257964288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065783 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065767.080832:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257964288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789065767.083177:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1789065767.164445:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:1.0:1789065767.164457:0:6711:0:(genops.c:885:class_export_put()) final put ffff9cf044fd8000/241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:0.0:1789065767.164521:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf044fd8000/241917dc-ba0e-425a-830a-a04cd9f8b120 for lustre-OST0000 00000020:00000080:0.0:1789065767.164595:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf044fd9000 for lustre-OST0000 00000001:00100000:0.0:1789065767.670673:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:0.0:1789065767.670681:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cf081645800/241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:3.0:1789065767.670741:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf081645800/241917dc-ba0e-425a-830a-a04cd9f8b120 for lustre-OST0001 00000020:00000080:3.0:1789065767.670799:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf081646000 for lustre-OST0001 00010000:00010000:3.0:1789065767.910048:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065768.104073:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257964800:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104151:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065768.104217:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789065768.104223:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257964416:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104252:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065768.104273:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257964928:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104295:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065768.104321:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257964544:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065768.104360:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257965056:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104379:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065768.104395:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065768.104400:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257964672:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104418:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065768.104451:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964800 00000100:00100000:0.0:1789065768.104459:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964800 00000100:00100000:0.0:1789065768.104497:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965056 00000100:00100000:0.0:1789065768.104508:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965056 00000100:00100000:0.0:1789065768.104539:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065768.104564:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257964800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104615:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257964800:12345-0@lo:400:kworker.0 Request processed in 68us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.104622:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065768.104637:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789065768.104644:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257965056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104674:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257965056:12345-0@lo:400:kworker.0 Request processed in 30us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.104679:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789065768.104697:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964416 00000100:00100000:0.0:1789065768.104700:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964416 00000100:00100000:0.0:1789065768.104721:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789065768.104727:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257964416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104753:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257964416:12345-0@lo:400:kworker.0 Request processed in 27us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.104759:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1789065768.104782:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964928 00000100:00100000:0.0:1789065768.104785:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964928 00000100:00100000:0.0:1789065768.104808:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964544 00000100:00100000:0.0:1789065768.104811:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964544 00000100:00100000:0.0:1789065768.104821:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257964672 00000100:00100000:0.0:1789065768.104823:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257964672 00000100:00100000:0.0:1789065768.104837:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789065768.104843:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257964928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104869:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257964928:12345-0@lo:400:kworker.0 Request processed in 27us (574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.104881:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789065768.104893:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789065768.104898:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257964544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104922:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257964544:12345-0@lo:400:kworker.0 Request processed in 23us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.104928:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789065768.104938:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789065768.104943:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257964672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.104965:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058216300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257964672:12345-0@lo:400:kworker.0 Request processed in 22us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.104985:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:0.0:1789065768.105006:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789065768.105010:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065768.105039:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257964672:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.105049:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd23100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257964544:0@lo:400:kworker.0 00010000:00080000:0.0:1789065768.105059:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd21c00 x1875971257965056/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065768.105069:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257965056:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.105097:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257964416:0@lo:400:kworker.0 00000100:00100000:0.0:1789065768.105105:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257964928:0@lo:400:kworker.0 00010000:00080000:0.0:1789065768.105115:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd22300 x1875971257964800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065768.105123:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257964800:0@lo:400:kworker.0 00000100:00100000:1.0:1789065768.119466:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789065768.119492:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257965184:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065768.119582:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065768.119751:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965184 00000100:00100000:3.0:1789065768.119761:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965184 00000100:00100000:3.0:1789065768.119817:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789065768.119827:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257965184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789065768.119867:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065768.119914:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257965184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065768.119921:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1789065768.121347:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e60e00 x1875971257965184/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065768.121373:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257965184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065768.871525:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065768.871615:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065768.872167:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913728 00000100:00100000:0.0:1789065768.872177:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913728 00000100:00100000:0.0:1789065768.872242:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:0.0:1789065768.872253:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235913728:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065768.872328:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235913728:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 76us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065768.872335:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00080000:0.0:1789065768.872367:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065768.872619:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913600 00000100:00100000:1.0:1789065768.872624:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913600 00000100:00100000:1.0:1789065768.872662:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00100000:1.0:1789065768.872670:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235913600:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065768.872706:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235913600:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 37us (1091us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065768.872713:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 199 00010000:00010000:0.0:1789065768.934059:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065769.960594:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065770.983222:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065772.006744:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065772.050824:0:9050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing yml_node 00000100:00100000:3.0:1789065772.197752:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789065772.197783:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257965312:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065772.197859:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065772.197954:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965312 00000100:00100000:3.0:1789065772.197962:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965312 00000100:00100000:3.0:1789065772.198062:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789065772.198073:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257965312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065772.198112:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065772.198159:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257965312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065772.198166:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1789065772.198189:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789065772.198215:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd22300 x1875971257965312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065788 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065772.198245:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257965312:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065773.045000:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065773.223225:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065773.223248:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257965440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065773.223315:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065773.223374:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965440 00000100:00100000:2.0:1789065773.223381:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965440 00000100:00100000:2.0:1789065773.223428:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789065773.223436:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257965440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065773.223468:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065773.223502:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257965440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065773.223520:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:2.0:1789065773.223539:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789065773.223625:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf08176a680 x1875971257965440/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065789 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065773.223643:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257965440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065773.224419:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257965568:0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.224461:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065773.224493:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257966080:0@lo:400:kworker.0 00000100:00100000:3.0:1789065773.224588:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965568 00000100:00100000:3.0:1789065773.224594:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965568 00000100:00100000:3.0:1789065773.224624:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789065773.224631:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257965568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065773.224664:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257965568:12345-0@lo:400:kworker.0 Request processed in 34us (203us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065773.224671:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1789065773.224895:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065773.224932:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257965568:0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.224942:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065773.224947:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257965696:0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.224964:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065773.224994:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966080 00000100:00100000:2.0:1789065773.224997:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966080 00000100:00100000:2.0:1789065773.225025:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965696 00000100:00100000:2.0:1789065773.225027:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965696 00000100:00100000:2.0:1789065773.225042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789065773.225048:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257966080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.225079:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257966080:12345-0@lo:400:kworker.0 Request processed in 31us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065773.225085:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789065773.225096:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789065773.225101:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257965696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.225379:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257965696:12345-0@lo:400:kworker.0 Request processed in 24us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065773.225386:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1789065773.225408:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065773.225419:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257965824:0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.225445:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065773.225496:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065773.225502:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257965952:0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.225535:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065773.225575:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965952 00000100:00100000:2.0:1789065773.225586:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965952 00000100:00100000:2.0:1789065773.225614:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789065773.225620:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257965952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.225655:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257965952:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065773.225661:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789065773.225680:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e62d80 x1875971257965952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065789 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065773.225687:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257965696:0@lo:400:kworker.0 00000100:00100000:1.0:1789065773.225691:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257965952:0@lo:400:kworker.0 00000100:00100000:2.0:1789065773.225695:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257966080:0@lo:400:kworker.0 00000100:00100000:3.0:1789065773.235063:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257965824 00000100:00100000:3.0:1789065773.235078:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257965824 00000100:00100000:3.0:1789065773.235244:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789065773.235255:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257965824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065773.235350:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257965824:12345-0@lo:400:kworker.0 Request processed in 97us (9903us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065773.235358:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789065773.235405:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257965824:0@lo:400:kworker.0 00000100:00080000:2.0:1789065773.245228:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065773.988123:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065773.988171:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065773.988757:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913984 00000100:00100000:1.0:1789065773.988771:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913984 00000100:00100000:2.0:1789065773.988782:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235913856 00000100:00100000:2.0:1789065773.988786:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235913856 00000100:00100000:2.0:1789065773.988834:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:1.0:1789065773.988834:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1789065773.988843:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2347:x1875971235913856:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065773.988843:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235913984:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065773.988922:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235913984:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 79us (750us total) trans 0 rc 0/0 00000100:00080000:3.0:1789065773.988926:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065773.988929:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1789065774.002544:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2347:x1875971235913856:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 13688us (14418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065774.002573:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 201 00010000:00010000:3.0:1789065774.053718:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065775.078433:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065776.105922:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065777.126155:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065777.323665:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065777.323689:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257966208:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065777.323765:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065777.323847:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966208 00000100:00100000:0.0:1789065777.323855:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966208 00000100:00100000:0.0:1789065777.323916:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789065777.323925:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257966208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065777.323969:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065777.324015:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257966208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065777.324023:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1789065777.324046:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065777.324078:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd22d80 x1875971257966208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065793 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065777.324096:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257966208:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1789065777.926048:0:9243:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.58.40 00010000:00010000:2.0:1789065778.153325:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065778.342041:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257966592:0@lo:400:kworker.0 00000100:00100000:2.0:1789065778.342111:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065778.342191:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065778.342198:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257966720:0@lo:400:kworker.0 00000100:00100000:2.0:1789065778.342225:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065778.342265:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966592 00000100:00100000:2.0:1789065778.342273:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966592 00000100:00100000:2.0:1789065778.342323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789065778.342332:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257966592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065778.342396:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257966592:12345-0@lo:400:kworker.0 Request processed in 64us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065778.342403:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1789065778.342425:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065778.342456:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc97800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257966592:0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.342543:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257966464:0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.342597:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065778.342614:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257966976:0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.342630:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065778.342647:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789065778.342651:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257966336:0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.342681:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065778.342700:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257966848:0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.342718:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065778.342752:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966336 00000100:00100000:0.0:1789065778.342757:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966336 00000100:00100000:0.0:1789065778.342794:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789065778.342801:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257966336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.342833:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257966336:12345-0@lo:400:kworker.0 Request processed in 33us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065778.342839:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1789065778.342871:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257966336:0@lo:400:kworker.0 00000100:00100000:2.0:1789065778.343866:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966464 00000100:00100000:2.0:1789065778.343876:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966464 00000100:00100000:1.0:1789065778.344081:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966720 00000100:00100000:1.0:1789065778.344086:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966720 00000100:00100000:1.0:1789065778.344115:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966976 00000100:00100000:1.0:1789065778.344117:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966976 00000100:00100000:1.0:1789065778.344149:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789065778.344158:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257966720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065778.344221:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257966720:12345-0@lo:400:kworker.0 Request processed in 64us (1994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065778.344228:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789065778.344243:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789065778.344249:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257966976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065778.344284:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257966976:12345-0@lo:400:kworker.0 Request processed in 35us (1652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065778.344306:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789065778.344350:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257966848 00000100:00100000:2.0:1789065778.344354:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257966848 00000100:00100000:0.0:1789065778.344416:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257967104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065778.344451:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789065778.344490:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fc95500 x1875971257966720/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065778.344503:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257966720:0@lo:400:kworker.0 00000100:00100000:0.0:1789065778.344533:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967104 00000100:00100000:0.0:1789065778.344543:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967104 00000100:00100000:0.0:1789065778.344587:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065778.344593:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257967104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065778.344624:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065778.344663:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257967104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065778.344668:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789065778.344697:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf081769500 x1875971257967104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065794 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065778.344711:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081769500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257967104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065778.347724:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789065778.347761:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257966464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065778.347868:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257966464:12345-0@lo:400:kworker.0 Request processed in 132us (5269us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065778.347891:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789065778.347918:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789065778.347925:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257966848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065778.347955:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257966848:12345-0@lo:400:kworker.0 Request processed in 31us (5237us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065778.347961:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1789065778.349983:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789065778.349994:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065778.350048:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a748380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257966848:0@lo:400:kworker.0 00000100:00100000:1.0:1789065778.350064:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc94000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257966464:0@lo:400:kworker.0 00010000:00080000:1.0:1789065778.350078:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07a74bb80 x1875971257966976/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065794 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065778.350089:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257966976:0@lo:400:kworker.0 00000100:00100000:1.0:1789065779.138145:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065779.138227:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065779.140055:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914240 00000100:00100000:0.0:1789065779.140070:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914240 00000100:00100000:0.0:1789065779.140147:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:0.0:1789065779.140158:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235914240:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065779.140246:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235914240:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 89us (2017us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065779.140254:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00080000:1.0:1789065779.140413:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065779.141515:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914112 00000100:00100000:2.0:1789065779.141538:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914112 00000100:00100000:2.0:1789065779.141605:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:2.0:1789065779.141614:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235914112:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065779.141681:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235914112:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 68us (3545us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065779.141688:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 203 00010000:00010000:1.0:1789065779.174629:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065780.198069:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065781.221646:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789065781.245184:0:9340:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.58.40 00010000:00010000:0.0:1789065782.247190:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065782.437915:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065782.437940:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257967232:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065782.438006:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065782.438355:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967232 00000100:00100000:0.0:1789065782.438364:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967232 00000100:00100000:0.0:1789065782.438430:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065782.438438:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257967232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065782.438473:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065782.438524:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257967232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065782.438531:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1789065782.438838:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065782.438881:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd22300 x1875971257967232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065798 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065782.438900:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257967232:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789065783.269805:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065783.463313:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257967616:0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.463427:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065783.463508:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065783.463515:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257967744:0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.463541:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065783.463605:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967616 00000100:00100000:0.0:1789065783.463612:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967616 00000100:00100000:0.0:1789065783.463670:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789065783.463692:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257967616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.464057:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257967616:12345-0@lo:400:kworker.0 Request processed in 377us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065783.464065:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789065783.464092:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967744 00000100:00100000:0.0:1789065783.464097:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967744 00000100:00100000:0.0:1789065783.464123:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065783.464130:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257967744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.464165:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257967744:12345-0@lo:400:kworker.0 Request processed in 36us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065783.464172:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1789065783.464188:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789065783.464221:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f480000 x1875971257967744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065783.464236:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257967744:0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.464261:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257967616:0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464374:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257967360:0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464422:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065783.464459:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257967872:0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464494:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065783.464514:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789065783.464520:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257967488:0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464539:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065783.464580:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257968000:0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464601:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065783.464625:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967872 00000100:00100000:3.0:1789065783.464630:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967872 00000100:00100000:3.0:1789065783.464661:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967488 00000100:00100000:3.0:1789065783.464663:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967488 00000100:00100000:3.0:1789065783.464694:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789065783.464708:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257967872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464756:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257967872:12345-0@lo:400:kworker.0 Request processed in 49us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065783.464763:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789065783.464776:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789065783.464782:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257967488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464809:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257967488:12345-0@lo:400:kworker.0 Request processed in 27us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065783.464814:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00080000:3.0:1789065783.464835:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065783.464854:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257967488:0@lo:400:kworker.0 00000100:00100000:3.0:1789065783.464863:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257967872:0@lo:400:kworker.0 00000100:00100000:1.0:1789065783.465244:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968000 00000100:00100000:1.0:1789065783.465249:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968000 00000100:00100000:1.0:1789065783.465284:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789065783.465291:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257968000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065783.465334:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257968000:12345-0@lo:400:kworker.0 Request processed in 44us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065783.465340:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789065783.465374:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789065783.465383:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065783.465417:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789065783.465440:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789065783.465458:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f483100 x1875971257968000/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065799 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065783.465496:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257968000:0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.465881:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257967360 00000100:00100000:0.0:1789065783.465886:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257967360 00000100:00100000:0.0:1789065783.465923:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789065783.465930:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257967360:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065783.465979:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257967360:12345-0@lo:400:kworker.0 Request processed in 49us (1557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065783.465986:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1789065783.466015:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968128 00000100:00100000:0.0:1789065783.466019:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968128 00000100:00100000:0.0:1789065783.466042:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789065783.466048:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257968128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065783.466075:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065783.466111:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257968128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065783.466116:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1789065783.466143:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf081769f80 x1875971257968128/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065799 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065783.466156:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081769f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257968128:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065783.466764:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257967360:0@lo:400:kworker.0 00000100:00100000:1.0:1789065784.229782:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065784.229821:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065784.229892:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914496 00000100:00100000:2.0:1789065784.229902:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914496 00000100:00100000:0.0:1789065784.229933:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914368 00000100:00100000:0.0:1789065784.229939:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914368 00000100:00100000:0.0:1789065784.229986:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:0.0:1789065784.229998:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235914368:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065784.230005:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:2.0:1789065784.230015:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235914496:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065784.230080:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235914496:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 67us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065784.230087:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:0.0:1789065784.237161:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235914368:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 7152us (7376us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065784.237190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00080000:1.0:1789065784.237723:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789065784.300500:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789065784.354841:0:9437:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.58.40 00010000:00010000:0.0:1789065785.317892:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065786.343123:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789065787.123861:0:9486:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Thu Sep 10 14:43:04 EDT 2026 00010000:00010000:0.0:1789065787.367716:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065787.557814:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065787.557840:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257968256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065787.557923:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065787.559187:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968256 00000100:00100000:3.0:1789065787.559210:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968256 00000100:00080000:1.0:1789065787.559407:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065787.567268:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789065787.567305:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257968256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065787.567382:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065787.567535:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257968256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 249us (9618us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065787.567544:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1789065787.586533:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec89f80 x1875971257968256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065803 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065787.586595:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257968256:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065788.390786:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065788.583311:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789065788.583332:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257968384:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065788.583390:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065788.583447:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968384 00000100:00100000:0.0:1789065788.583453:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968384 00000100:00100000:0.0:1789065788.583499:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065788.583507:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257968384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065788.583540:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065788.583611:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257968384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065788.583618:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:0.0:1789065788.583636:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789065788.583663:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec8a300 x1875971257968384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065804 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065788.583679:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257968384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065788.584273:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257968896:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584307:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065788.584341:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789065788.584346:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257968512:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584373:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065788.584389:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257969024:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584407:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065788.584427:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257968768:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065788.584457:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065788.584461:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257968640:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584478:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065788.584497:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968512 00000100:00100000:2.0:1789065788.584501:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968512 00000100:00100000:2.0:1789065788.584524:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789065788.584530:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257968512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584597:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257968512:12345-0@lo:400:kworker.0 Request processed in 66us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065788.584603:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1789065788.584627:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969024 00000100:00100000:2.0:1789065788.584630:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969024 00000100:00100000:2.0:1789065788.584653:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968768 00000100:00100000:2.0:1789065788.584655:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968768 00000100:00100000:2.0:1789065788.584665:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968640 00000100:00100000:2.0:1789065788.584667:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968640 00000100:00100000:2.0:1789065788.584676:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789065788.584694:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257969024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584720:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257969024:12345-0@lo:400:kworker.0 Request processed in 27us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065788.584725:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789065788.584735:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789065788.584740:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257968768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584760:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257968768:12345-0@lo:400:kworker.0 Request processed in 20us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065788.584766:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789065788.584774:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789065788.584778:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257968640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584796:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257968640:12345-0@lo:400:kworker.0 Request processed in 18us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065788.584801:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789065788.584827:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257968512:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584835:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257969024:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584859:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257968640:0@lo:400:kworker.0 00000100:00100000:2.0:1789065788.584867:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257968768:0@lo:400:kworker.0 00000100:00100000:3.0:1789065788.585001:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257968896 00000100:00100000:3.0:1789065788.585006:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257968896 00000100:00100000:3.0:1789065788.585042:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789065788.585048:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257968896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065788.585083:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257968896:12345-0@lo:400:kworker.0 Request processed in 35us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065788.585099:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:0.0:1789065788.585322:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1789065788.586164:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e63480 x1875971257968896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065804 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065788.586181:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257968896:0@lo:400:kworker.0 00000100:00100000:3.0:1789065789.351767:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065789.351816:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065789.352051:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914624 00000100:00100000:1.0:1789065789.352061:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914624 00000100:00100000:1.0:1789065789.352120:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:1.0:1789065789.352130:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235914624:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065789.352238:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235914624:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 107us (479us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065789.352247:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:2.0:1789065789.352442:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914752 00000100:00100000:2.0:1789065789.352449:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914752 00000100:00100000:2.0:1789065789.352518:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1789065789.352525:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235914752:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065789.352595:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235914752:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 69us (777us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065789.352602:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00080000:1.0:1789065789.352992:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789065789.416670:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065790.438124:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065791.463973:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065792.485766:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065792.678053:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257969152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065792.678151:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065792.678321:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969152 00000100:00100000:0.0:1789065792.678331:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969152 00000100:00100000:0.0:1789065792.678396:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789065792.678421:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257969152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065792.678456:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065792.678516:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257969152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065792.678523:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789065792.680136:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789065792.680193:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec8a300 x1875971257969152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065808 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065792.680213:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257969152:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065793.528521:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065793.710441:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257969280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065793.710731:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065793.710805:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969280 00000100:00100000:3.0:1789065793.710813:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969280 00000100:00100000:3.0:1789065793.710863:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789065793.710871:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257969280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789065793.710908:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065793.711232:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257969408:0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.711273:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065793.711314:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969408 00000100:00100000:2.0:1789065793.711318:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969408 00000100:00100000:2.0:1789065793.711345:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789065793.711352:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257969408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.711387:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257969408:12345-0@lo:400:kworker.0 Request processed in 36us (113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065793.711395:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1789065793.711443:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257969408:0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.711504:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257969536:0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.711529:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065793.711570:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969536 00000100:00100000:2.0:1789065793.711574:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969536 00000100:00100000:3.0:1789065793.711701:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257969280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 830us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065793.711709:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789065793.711728:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789065793.711754:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e63480 x1875971257969280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065809 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065793.711772:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257969280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065793.711823:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789065793.711831:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257969536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.711875:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257969536:12345-0@lo:400:kworker.0 Request processed in 45us (344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065793.711881:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789065793.714402:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257969664:0@lo:400:kworker.0 00000100:00100000:0.0:1789065793.714473:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065793.714561:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969664 00000100:00100000:0.0:1789065793.714569:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969664 00000100:00100000:0.0:1789065793.714624:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789065793.714633:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257969664:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1789065793.714676:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065793.714682:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257969664:12345-0@lo:400:kworker.0 Request processed in 51us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065793.714689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789065793.714713:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257969536:0@lo:400:kworker.0 00000100:00100000:0.0:1789065793.714717:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257969664:0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.714835:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257969920:0@lo:400:kworker.0 00000100:00100000:2.0:1789065793.714862:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065793.714889:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969920 00000100:00100000:2.0:1789065793.714893:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969920 00000100:00100000:2.0:1789065793.714920:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789065793.714927:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257969920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065793.715184:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065793.715194:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257969792:0@lo:400:kworker.0 00000100:00100000:0.0:1789065793.715227:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065793.715259:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257969792 00000100:00100000:0.0:1789065793.715263:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257969792 00000100:00100000:0.0:1789065793.715291:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065793.715297:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257969792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065793.715331:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257969792:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065793.715336:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789065793.715364:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbce00 x1875971257969792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065809 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065793.715536:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257969920:12345-0@lo:400:kworker.0 Request processed in 608us (672us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065793.715543:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789065793.715692:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257969792:0@lo:400:kworker.0 00000100:00080000:3.0:1789065793.715770:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065793.716476:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257969920:0@lo:400:kworker.0 00000100:00100000:0.0:1789065794.472818:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065794.472881:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065794.472949:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915008 00000100:00100000:2.0:1789065794.472960:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915008 00000100:00100000:2.0:1789065794.473037:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:2.0:1789065794.473048:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235915008:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065794.473133:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235915008:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 87us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065794.473141:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00080000:0.0:1789065794.473451:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065794.474618:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235914880 00000100:00100000:1.0:1789065794.474629:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235914880 00000100:00100000:1.0:1789065794.474675:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:1.0:1789065794.474685:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235914880:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065794.474759:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235914880:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 62us (1864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065794.474767:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 209 00010000:00010000:0.0:1789065794.535491:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065795.557977:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065796.581744:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065797.611279:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065797.797899:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257970048:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065797.797980:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065797.798096:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970048 00000100:00100000:1.0:1789065797.798106:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970048 00000100:00100000:1.0:1789065797.798171:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789065797.798181:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257970048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789065797.798217:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065797.798264:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257970048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065797.798272:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789065797.798337:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789065797.798366:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf08176b100 x1875971257970048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065797.798398:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257970048:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065798.641167:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065798.824455:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065798.824480:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257970176:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065798.824568:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065798.825293:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257970432:0@lo:400:kworker.0 00000100:00100000:0.0:1789065798.825335:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065798.825362:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065798.825368:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257970560:0@lo:400:kworker.0 00000100:00100000:0.0:1789065798.825401:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065798.825434:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970432 00000100:00100000:0.0:1789065798.825441:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970432 00000100:00100000:0.0:1789065798.825482:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970560 00000100:00100000:0.0:1789065798.825486:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970560 00000100:00100000:0.0:1789065798.825516:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789065798.825524:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257970432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065798.825600:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257970432:12345-0@lo:400:kworker.0 Request processed in 76us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065798.825608:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789065798.825625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789065798.825632:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257970560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065798.825663:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257970560:12345-0@lo:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065798.825670:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1789065798.825711:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065798.827117:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257970560:0@lo:400:kworker.0 00000100:00100000:0.0:1789065798.827136:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec88380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257970432:0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.827248:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257970688:0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.827302:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065798.827352:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789065798.827359:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257970304:0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.827401:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065798.827432:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257970816:0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.827459:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065798.827498:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970176 00000100:00100000:1.0:1789065798.827517:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970176 00000100:00100000:1.0:1789065798.827608:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789065798.827618:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257970176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065798.827656:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065798.827700:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257970176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (3150us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065798.827707:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789065798.827728:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970304 00000100:00100000:1.0:1789065798.827860:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970304 00000100:00100000:1.0:1789065798.827892:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:1.0:1789065798.827899:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257970304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.828028:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257970304:12345-0@lo:400:kworker.0 Request processed in 129us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065798.828034:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00080000:1.0:1789065798.828070:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065798.828090:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257970304:0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.828112:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970816 00000100:00100000:1.0:1789065798.828115:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970816 00000100:00100000:1.0:1789065798.828149:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789065798.828155:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257970816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065798.828191:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257970816:12345-0@lo:400:kworker.0 Request processed in 35us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065798.828196:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:1.0:1789065798.828213:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065798.828227:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257970816:0@lo:400:kworker.0 00010000:00080000:3.0:1789065798.828711:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e63480 x1875971257970176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065814 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065798.828747:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257970176:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065798.828865:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970688 00000100:00100000:0.0:1789065798.828870:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970688 00000100:00100000:0.0:1789065798.828907:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789065798.828916:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257970688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065798.828984:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257970688:12345-0@lo:400:kworker.0 Request processed in 70us (1681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065798.828991:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:3.0:1789065798.829460:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec89180 x1875971257970688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065814 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065798.829472:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257970688:0@lo:400:kworker.0 00000100:00100000:1.0:1789065799.596129:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065799.596188:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065799.596262:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915264 00000100:00100000:0.0:1789065799.596273:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915264 00000100:00100000:0.0:1789065799.596347:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1789065799.596358:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235915264:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065799.596452:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235915264:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 96us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065799.596460:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00080000:1.0:1789065799.596806:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065799.605001:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915136 00000100:00100000:3.0:1789065799.605017:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915136 00000100:00100000:3.0:1789065799.605187:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:3.0:1789065799.605199:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235915136:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065799.605321:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971235915136:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 124us (9201us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065799.605330:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 211 00010000:00010000:1.0:1789065799.653706:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065800.689481:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065801.703771:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065802.725739:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065802.920630:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257970944:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065802.920704:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065802.920793:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257970944 00000100:00100000:2.0:1789065802.920812:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257970944 00000100:00100000:2.0:1789065802.920890:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789065802.920901:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257970944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065802.920935:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065802.920989:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257970944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065802.920996:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:1.0:1789065802.921704:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf081768380 x1875971257970944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065802.921725:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257970944:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789065802.921947:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789065803.754820:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065803.941812:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065803.941839:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257971072:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.941925:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065803.941990:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971072 00000100:00100000:2.0:1789065803.941999:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971072 00000100:00100000:2.0:1789065803.942041:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789065803.942051:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257971072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942108:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257971072:12345-0@lo:400:kworker.0 Request processed in 58us (183us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065803.942115:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1789065803.942165:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257971072:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942211:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257971200:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942239:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065803.942301:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971200 00000100:00100000:2.0:1789065803.942306:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971200 00000100:00100000:2.0:1789065803.942332:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789065803.942337:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257971200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942370:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257971200:12345-0@lo:400:kworker.0 Request processed in 33us (130us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065803.942391:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789065803.942421:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257971200:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942450:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257971328:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942472:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065803.942498:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971328 00000100:00100000:2.0:1789065803.942502:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971328 00000100:00100000:2.0:1789065803.942530:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789065803.942537:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257971328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942601:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257971328:12345-0@lo:400:kworker.0 Request processed in 64us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065803.942607:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:2.0:1789065803.942623:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065803.942645:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257971328:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942672:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257971456:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942695:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065803.942720:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971456 00000100:00100000:2.0:1789065803.942724:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971456 00000100:00100000:2.0:1789065803.942749:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789065803.942756:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257971456:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942789:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257971456:12345-0@lo:400:kworker.0 Request processed in 33us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065803.942795:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:2.0:1789065803.942823:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbd180 x1875971257971456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065803.942832:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257971456:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942868:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065803.942874:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257971584:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942897:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065803.942917:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971584 00000100:00100000:2.0:1789065803.942920:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971584 00000100:00100000:2.0:1789065803.942941:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789065803.942946:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257971584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.942972:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257971584:12345-0@lo:400:kworker.0 Request processed in 26us (75us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065803.942978:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1789065803.942991:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065803.943005:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257971584:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.943033:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257971712:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.943052:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065803.943078:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971712 00000100:00100000:2.0:1789065803.943081:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971712 00000100:00100000:2.0:1789065803.943109:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789065803.943114:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257971712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.943145:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257971712:12345-0@lo:400:kworker.0 Request processed in 31us (92us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065803.943150:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1789065803.943166:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789065803.943183:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbd180 x1875971257971712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065819 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065803.943192:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257971712:0@lo:400:kworker.0 00000100:00100000:2.0:1789065803.952477:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257971840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065803.952594:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065803.953098:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971840 00000100:00100000:1.0:1789065803.953107:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971840 00000100:00100000:1.0:1789065803.953161:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789065803.953170:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257971840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065803.953223:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065803.953453:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257971840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 284us (859us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065803.953461:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:2.0:1789065803.953541:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf081768380 x1875971257971840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065819 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065803.953594:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081768380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257971840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065804.708621:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065804.708682:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915520 00000100:00100000:3.0:1789065804.708696:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915520 00000100:00100000:1.0:1789065804.708700:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065804.708795:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:3.0:1789065804.708810:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235915520:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065804.708899:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235915520:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 93us (291us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065804.708906:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:3.0:1789065804.708928:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915392 00000100:00100000:3.0:1789065804.708932:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915392 00000100:00100000:3.0:1789065804.708957:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00100000:3.0:1789065804.708964:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235915392:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065804.708992:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971235915392:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065804.709007:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00080000:3.0:1789065804.710045:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789065804.775366:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065805.798585:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065806.822305:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065807.846132:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065808.047498:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789065808.047535:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257971968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065808.047695:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065808.047783:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257971968 00000100:00100000:3.0:1789065808.047794:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257971968 00000100:00100000:3.0:1789065808.047876:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789065808.047889:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257971968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065808.047941:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065808.048002:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257971968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065808.048009:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1789065808.048035:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789065808.049265:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf081769180 x1875971257971968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065824 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065808.049296:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081769180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257971968:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789065808.232129:0:10117:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 14:43:25 (1789065805) === 00010000:00010000:1.0:1789065808.869730:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065808.885002:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065808.885103:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915648 00000100:00100000:1.0:1789065808.885114:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915648 00000100:00100000:1.0:1789065808.885175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:1.0:1789065808.885186:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:8134:x1875971235915648:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789065808.885213:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065808.885250:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b073400/0x7555615576c82690 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdbaf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065808.885288:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b073400/0x7555615576c82690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbaf expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065808.885300:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b073400/0x7555615576c82690 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbaf expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065808.885310:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073400, rc 0) 00000100:00100000:1.0:1789065808.885366:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8134:x1875971235915648:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 182us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065808.885373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:1.0:1789065808.890396:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065808.890497:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915776 00000100:00100000:2.0:1789065808.890507:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915776 00000100:00100000:2.0:1789065808.890594:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:2.0:1789065808.890605:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8134:x1875971235915776:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:2.0:1789065808.890899:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8134:x1875971235915776:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 295us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065808.890908:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:2.0:1789065808.893638:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065808.893783:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235915904 00000100:00100000:3.0:1789065808.893793:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235915904 00000100:00100000:3.0:1789065808.893847:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:3.0:1789065808.893858:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8134:x1875971235915904:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789065808.894105:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8134:x1875971235915904:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 248us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065808.894114:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:3.0:1789065808.903603:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065808.905656:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916032 00000100:00100000:1.0:1789065808.905670:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916032 00000100:00100000:1.0:1789065808.905734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:1.0:1789065808.905744:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8138:x1875971235916032:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789065808.906045:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8138:x1875971235916032:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 302us (2451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065808.906058:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:1.0:1789065808.932929:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065808.933146:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916160 00000100:00100000:2.0:1789065808.933164:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916160 00000100:00100000:2.0:1789065808.933222:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:2.0:1789065808.933232:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8138:x1875971235916160:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789065808.933503:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8138:x1875971235916160:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 271us (583us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065808.933511:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:2.0:1789065808.939119:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065808.939225:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916288 00000100:00100000:3.0:1789065808.939236:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916288 00000100:00100000:3.0:1789065808.939292:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 219 00000100:00100000:3.0:1789065808.939303:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:8134:x1875971235916288:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789065808.939330:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065808.939363:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041683800/0x7555615576c82697 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdbd9 expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065808.939401:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041683800/0x7555615576c82697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbd9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065808.939414:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041683800/0x7555615576c82697 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbd9 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065808.939423:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041683800, rc 0) 00000100:00100000:3.0:1789065808.939493:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:8134:x1875971235916288:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 191us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065808.939499:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 219 00000100:00100000:3.0:1789065808.952629:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065808.953492:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916416 00000100:00100000:1.0:1789065808.953505:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916416 00000100:00100000:1.0:1789065808.953597:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:1.0:1789065808.953610:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:8134:x1875971235916416:12345-192.168.204.23@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789065808.953638:0:5833:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789065808.953668:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789065808.953672:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789065808.953675:0:5833:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789065808.953677:0:5833:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1789065808.960699:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:8134:x1875971235916416:12345-192.168.204.23@tcp:256:mount.lustre.0 Request processed in 7082us (8068us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065808.960713:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:2.0:1789065808.964728:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065808.964895:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916544 00000100:00100000:0.0:1789065808.964905:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916544 00000100:00100000:0.0:1789065808.965328:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 221 00000100:00100000:0.0:1789065808.965340:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:8134:x1875971235916544:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789065808.965359:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065808.965388:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdbe0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065808.965421:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065808.965467:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065808.965476:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ffa00, rc 0) 00000100:00100000:0.0:1789065808.965541:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8134:x1875971235916544:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 203us (823us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065808.965575:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 221 00000100:00100000:3.0:1789065808.977339:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065808.978382:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916672 00000100:00100000:1.0:1789065808.978396:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916672 00000100:00100000:1.0:1789065808.978524:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:1.0:1789065808.978535:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8134:x1875971235916672:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789065808.978862:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8134:x1875971235916672:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 327us (1530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065808.978871:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:2.0:1789065808.984463:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065808.985417:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916800 00000100:00100000:0.0:1789065808.985430:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916800 00000100:00100000:0.0:1789065808.985493:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:0.0:1789065808.985503:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8134:x1875971235916800:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789065808.985790:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8134:x1875971235916800:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 287us (1333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065808.985810:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:0.0:1789065809.003917:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.004598:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235916928 00000100:00100000:3.0:1789065809.004609:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235916928 00000100:00100000:3.0:1789065809.004667:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:3.0:1789065809.004677:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8142:x1875971235916928:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789065809.004925:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8142:x1875971235916928:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 248us (1018us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.004932:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:3.0:1789065809.016727:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065809.017443:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917056 00000100:00100000:1.0:1789065809.017454:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917056 00000100:00100000:1.0:1789065809.017515:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 225 00000100:00100000:1.0:1789065809.017526:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8142:x1875971235917056:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789065809.018574:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:8142:x1875971235917056:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 1021us (1828us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065809.018587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 225 00000100:00100000:2.0:1789065809.029641:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065809.029698:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.029791:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917312 00000100:00100000:0.0:1789065809.029791:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917184 00000100:00100000:3.0:1789065809.029800:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917312 00000100:00100000:0.0:1789065809.029800:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917184 00000100:00100000:0.0:1789065809.029855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00080000:2.0:1789065809.029944:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065809.030092:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235917312:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065809.030170:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235917312:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 84us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.034396:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1789065809.034413:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2346:x1875971235917184:12345-192.168.204.23@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789065809.034450:0:8255:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 59a5cafc-7436-4bd4-96e7-6564036805b9@192.168.204.23@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1789065809.034511:0:8255:0:(genops.c:1384:class_connect()) connect: client 59a5cafc-7436-4bd4-96e7-6564036805b9, cookie 0x7555615576c826a5 00000004:00100000:3.0:1789065809.034543:0:8255:0:(mdt_handler.c:7352:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789065809.039564:0:8255:0:(import.c:65:import_set_state_nolock()) ffff9cf07f17a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789065809.039641:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2346:x1875971235917184:12345-192.168.204.23@tcp:38:mount.lustre.0 Request processed in 5228us (9939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.039654:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:3.0:1789065809.049417:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.049609:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065809.049758:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1789065809.071173:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917440 00000100:00100000:0.0:1789065809.071199:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917440 00000100:00100000:2.0:1789065809.071335:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917568 00000100:00100000:2.0:1789065809.071340:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917568 00000100:00080000:3.0:1789065809.071395:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065809.071419:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1789065809.071542:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+7:0:x1875971235917440:12345-192.168.204.23@tcp:41:mount.lustre.0 00000100:00100000:3.0:1789065809.071543:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257972608:0@lo:400:kworker.0 00000004:00000024:1.0:1789065809.071600:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789065809.071624:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065809.071681:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+7:0:x1875971235917440:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 252us (22274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065809.071689:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1789065809.071708:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789065809.071714:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:8134:x1875971235917568:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789065809.071748:0:5838:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789065809.071786:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:8134:x1875971235917568:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 72us (22177us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065809.071793:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789065809.071826:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257972096:0@lo:400:kworker.0 00000100:00100000:1.0:1789065809.071860:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065809.071893:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972096 00000100:00100000:1.0:1789065809.071898:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972096 00000100:00100000:1.0:1789065809.071922:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:1.0:1789065809.071929:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257972096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065809.071961:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257972096:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065809.071968:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1789065809.071994:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257972352:0@lo:400:kworker.0 00000100:00100000:3.0:1789065809.072028:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065809.072237:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972608 00000100:00100000:0.0:1789065809.072242:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972608 00000100:00100000:0.0:1789065809.072272:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789065809.072278:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257972608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.072394:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257972608:12345-0@lo:400:kworker.0 Request processed in 115us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065809.072400:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789065809.072420:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257972480:0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.072444:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789065809.073372:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058002d80 x1875971257972608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065809.073387:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257972608:0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.073520:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972352 00000100:00100000:0.0:1789065809.073526:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972352 00000100:00100000:0.0:1789065809.073654:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972480 00000100:00100000:0.0:1789065809.073658:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972480 00000100:00100000:0.0:1789065809.073695:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789065809.073701:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257972352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.074145:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257972352:12345-0@lo:400:kworker.0 Request processed in 442us (2115us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065809.074152:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789065809.074172:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789065809.074179:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257972480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.074226:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257972480:12345-0@lo:400:kworker.0 Request processed in 49us (1781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065809.074232:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1789065809.074250:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065809.074657:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257972096:0@lo:400:kworker.0 00000100:00100000:1.0:1789065809.074670:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257972224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065809.074723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065809.075595:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257972352:0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.075605:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257972864:0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.075641:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065809.075755:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972864 00000100:00100000:0.0:1789065809.075761:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972864 00000100:00100000:0.0:1789065809.075818:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789065809.075825:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257972864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.075868:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257972864:12345-0@lo:400:kworker.0 Request processed in 43us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065809.075875:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:0.0:1789065809.075892:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789065809.075914:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058003480 x1875971257972864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065809.075924:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058003480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257972864:0@lo:400:kworker.0 00000100:00100000:1.0:1789065809.076266:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058001f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257972480:0@lo:400:kworker.0 00000100:00100000:3.0:1789065809.080479:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972224 00000100:00100000:3.0:1789065809.080497:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972224 00000100:00100000:3.0:1789065809.080583:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789065809.080594:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257972224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789065809.080639:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065809.080723:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257972224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 132us (5999us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.080741:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789065809.081466:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065809.081622:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917696 00000100:00100000:2.0:1789065809.081630:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917696 00000100:00100000:2.0:1789065809.081867:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1789065809.081877:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:8134:x1875971235917696:12345-192.168.204.23@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789065809.081989:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:8134:x1875971235917696:12345-192.168.204.23@tcp:40:mount.lustre.0 Request processed in 113us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065809.081998:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1789065809.085626:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.085735:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.085760:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.085804:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.085826:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.085848:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065809.085874:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917824 00000100:00100000:3.0:1789065809.085883:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917824 00000100:00100000:3.0:1789065809.085914:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235917952 00000100:00100000:3.0:1789065809.085917:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235917952 00000100:00100000:3.0:1789065809.085931:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1789065809.085939:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875971235917824:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789065809.085970:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 59a5cafc-7436-4bd4-96e7-6564036805b9@192.168.204.23@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1789065809.086008:0:6685:0:(genops.c:1384:class_connect()) connect: client 59a5cafc-7436-4bd4-96e7-6564036805b9, cookie 0x7555615576c826ac 00002000:00100000:3.0:1789065809.086019:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 59a5cafc-7436-4bd4-96e7-6564036805b9/ffff9cf07f17e000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789065809.086030:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789065809.086352:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789065809.086384:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9cf07f178000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789065809.086447:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2346:x1875971235917824:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 508us (620us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.086455:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:3.0:1789065809.086473:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1789065809.086477:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875971235917952:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789065809.086491:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 59a5cafc-7436-4bd4-96e7-6564036805b9@192.168.204.23@tcp t0 exp 0000000000000000 cur 268 last 0 00000020:00000080:3.0:1789065809.086509:0:6685:0:(genops.c:1384:class_connect()) connect: client 59a5cafc-7436-4bd4-96e7-6564036805b9, cookie 0x7555615576c826b3 00002000:00100000:3.0:1789065809.086513:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 59a5cafc-7436-4bd4-96e7-6564036805b9/ffff9cf07f17b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789065809.086528:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789065809.086673:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789065809.086689:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9cf07f17b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789065809.086712:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2346:x1875971235917952:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 233us (863us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.086720:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:3.0:1789065809.086757:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918464 00000100:00100000:3.0:1789065809.086762:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918464 00000100:00100000:3.0:1789065809.086789:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918336 00000100:00100000:3.0:1789065809.086792:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918336 00000100:00100000:3.0:1789065809.086805:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:3.0:1789065809.086810:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2350:x1875971235918464:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065809.086839:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2350:x1875971235918464:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.086845:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:3.0:1789065809.086857:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:3.0:1789065809.086863:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235918336:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065809.086887:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235918336:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 24us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065809.086892:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:1.0:1789065809.087470:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918080 00000100:00100000:1.0:1789065809.087476:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918080 00000100:00100000:1.0:1789065809.087580:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:1.0:1789065809.087588:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:8134:x1875971235918080:12345-192.168.204.23@tcp:33:mount.lustre.0 00010000:00080000:0.0:1789065809.087615:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf081769880 x1875971257972224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065809.087651:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081769880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257972224:0@lo:13:osp-pre-1-0.0 00000004:00200000:1.0:1789065809.087652:0:5841:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789065809.087677:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257972736:0@lo:400:kworker.0 00000100:00100000:1.0:1789065809.087711:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:8134:x1875971235918080:12345-192.168.204.23@tcp:33:mount.lustre.0 Request processed in 124us (2167us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065809.087723:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1789065809.087723:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065809.087993:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972736 00000100:00100000:1.0:1789065809.087998:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972736 00000100:00100000:0.0:1789065809.088027:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918208 00000100:00100000:0.0:1789065809.088032:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918208 00000100:00100000:1.0:1789065809.088045:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1789065809.088051:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257972736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065809.088066:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 227 00000100:00100000:0.0:1789065809.088072:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235918208:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065809.088087:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257972736:12345-0@lo:400:kworker.0 Request processed in 37us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065809.088094:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235918208:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 23us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065809.088100:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 227 00000100:00100000:1.0:1789065809.088105:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789065809.088134:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257972736:0@lo:400:kworker.0 00000100:00080000:2.0:1789065809.093148:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789065809.893772:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065810.918897:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065811.944841:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065812.976489:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065813.158698:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257972992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065813.158769:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065813.160037:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257972992 00000100:00100000:1.0:1789065813.160048:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257972992 00000100:00100000:1.0:1789065813.160134:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789065813.160145:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257972992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789065813.160182:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065813.160251:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257972992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (1481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065813.160258:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:1.0:1789065813.160589:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf08176b100 x1875971257972992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065829 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065813.160610:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257972992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789065813.160738:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1789065813.206274:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59a5cafc-7436-4bd4-96e7-6564036805b9 00000001:00100000:2.0:1789065813.736277:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59a5cafc-7436-4bd4-96e7-6564036805b9 00000001:00100000:1.0:1789065813.737894:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59a5cafc-7436-4bd4-96e7-6564036805b9 00010000:00010000:1.0:1789065813.993251:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065814.181752:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257973248:0@lo:400:kworker.0 00000100:00100000:3.0:1789065814.181825:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065814.181901:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257973760:0@lo:400:kworker.0 00000100:00100000:3.0:1789065814.181924:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065814.181950:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789065814.181970:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257973120:0@lo:400:kworker.0 00000100:00100000:3.0:1789065814.181999:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065814.182010:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257973376:0@lo:400:kworker.0 00000100:00100000:3.0:1789065814.182022:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257973632:0@lo:400:kworker.0 00000100:00100000:1.0:1789065814.182039:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065814.182058:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257973888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065814.182113:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065814.182142:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973760 00000100:00100000:3.0:1789065814.182144:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257973504:0@lo:400:kworker.0 00000100:00100000:2.0:1789065814.182150:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973760 00000100:00100000:3.0:1789065814.182191:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065814.182236:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973248 00000100:00100000:0.0:1789065814.182241:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973248 00000100:00100000:0.0:1789065814.182272:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973376 00000100:00100000:0.0:1789065814.182275:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973376 00000100:00100000:0.0:1789065814.182291:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973632 00000100:00100000:0.0:1789065814.182293:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973632 00000100:00100000:0.0:1789065814.182311:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789065814.182321:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257973248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065814.182384:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257973248:12345-0@lo:400:kworker.0 Request processed in 64us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.182392:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789065814.182433:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789065814.182440:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257973376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065814.182472:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257973376:12345-0@lo:400:kworker.0 Request processed in 33us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.182478:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789065814.182490:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789065814.182496:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257973632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065814.182524:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257973632:12345-0@lo:400:kworker.0 Request processed in 28us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.182530:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789065814.182589:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973120 00000100:00100000:0.0:1789065814.182594:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973120 00000100:00100000:0.0:1789065814.182619:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1789065814.182626:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257973120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065814.182658:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257973120:12345-0@lo:400:kworker.0 Request processed in 32us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.182664:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:1.0:1789065814.184600:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065814.184671:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257973376:0@lo:400:kworker.0 00000100:00100000:1.0:1789065814.184714:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973888 00000100:00100000:1.0:1789065814.184720:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973888 00000100:00100000:1.0:1789065814.184821:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789065814.184830:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971257973888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065814.184870:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065814.184916:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971257973888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065814.184923:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789065814.184957:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf08176b100 x1875971257973888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065830 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065814.184972:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257973888:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065814.185147:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257973504 00000100:00100000:2.0:1789065814.185152:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257973504 00000100:00100000:2.0:1789065814.185190:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789065814.185198:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257973760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065814.185237:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257973760:12345-0@lo:400:kworker.0 Request processed in 40us (3311us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065814.185244:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789065814.185256:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789065814.185262:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257973504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065814.185297:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257973504:12345-0@lo:400:kworker.0 Request processed in 35us (3128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065814.185318:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1789065814.185350:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec89f80 x1875971257973504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065814.185360:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257973504:0@lo:400:kworker.0 00000100:00100000:2.0:1789065814.185403:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257973120:0@lo:400:kworker.0 00000100:00100000:2.0:1789065814.185416:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257973632:0@lo:400:kworker.0 00000100:00080000:0.0:1789065814.186182:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789065814.186190:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789065814.186871:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fc96680 x1875971257973760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065830 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065814.186884:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc96680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257973760:0@lo:400:kworker.0 00000100:00100000:2.0:1789065814.186897:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257973248:0@lo:400:kworker.0 00000100:00100000:1.0:1789065814.445916:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065814.445964:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065814.446007:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065814.446047:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065814.446129:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918592 00000100:00100000:3.0:1789065814.446139:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918592 00000100:00100000:3.0:1789065814.446196:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:3.0:1789065814.446207:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235918592:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065814.446286:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235918592:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 80us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065814.446294:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:0.0:1789065814.446583:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918720 00000100:00100000:0.0:1789065814.446588:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918720 00000100:00100000:0.0:1789065814.446632:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918848 00000100:00100000:0.0:1789065814.446636:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918848 00000100:00100000:0.0:1789065814.446659:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:0.0:1789065814.446667:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235918720:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065814.446708:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235918720:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 42us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.446733:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:0.0:1789065814.446749:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:0.0:1789065814.446756:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235918848:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065814.446784:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235918848:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 29us (737us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.446790:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00080000:3.0:1789065814.447745:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065814.448724:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235918976 00000100:00100000:2.0:1789065814.448869:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235918976 00000100:00100000:2.0:1789065814.448954:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:2.0:1789065814.448965:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235918976:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:3.0:1789065814.449023:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065814.449042:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235918976:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 78us (3076us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065814.449051:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:3.0:1789065814.455424:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065814.456245:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919104 00000100:00100000:0.0:1789065814.456258:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919104 00000100:00100000:0.0:1789065814.456355:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:0.0:1789065814.456366:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235919104:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065814.456491:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235919104:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 126us (1078us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065814.456501:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00080000:3.0:1789065814.467127:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1789065815.013772:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065816.037696:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065816.434504:0:10312:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789065817.062388:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065818.090098:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065818.279936:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257974016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065818.280000:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065818.280106:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974016 00000100:00100000:2.0:1789065818.280114:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974016 00000100:00100000:2.0:1789065818.280162:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789065818.280169:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257974016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065818.280202:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065818.289093:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257974016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8912us (9080us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065818.289109:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1789065818.289144:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789065818.294779:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbdf80 x1875971257974016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065834 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065818.294812:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257974016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065819.111774:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065819.301927:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789065819.314119:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257974272:0@lo:400:kworker.0 00000100:00100000:0.0:1789065819.314214:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065819.314276:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257974144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065819.314316:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065819.314377:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974144 00000100:00100000:0.0:1789065819.314386:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974144 00000100:00100000:0.0:1789065819.314442:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789065819.314451:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257974144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065819.314500:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065819.314577:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257974144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 127us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065819.314585:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:0.0:1789065819.314607:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789065819.314640:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec88e00 x1875971257974144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065835 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065819.314659:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257974144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065819.315107:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974272 00000100:00100000:1.0:1789065819.315114:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974272 00000100:00100000:1.0:1789065819.315159:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:1.0:1789065819.315166:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257974272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065819.315218:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257974272:12345-0@lo:400:kworker.0 Request processed in 52us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065819.315225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:2.0:1789065819.315435:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257974400:0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.315479:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065819.315506:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065819.315512:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257974528:0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.315533:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065819.315579:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974400 00000100:00100000:2.0:1789065819.315583:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974400 00000100:00100000:2.0:1789065819.315608:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974528 00000100:00100000:2.0:1789065819.315611:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974528 00000100:00100000:2.0:1789065819.315635:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789065819.315642:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257974400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.315677:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257974400:12345-0@lo:400:kworker.0 Request processed in 36us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065819.315683:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789065819.315696:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789065819.315702:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257974528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.315727:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257974528:12345-0@lo:400:kworker.0 Request processed in 26us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065819.315733:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:2.0:1789065819.315755:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065819.315775:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257974528:0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.315784:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257974400:0@lo:400:kworker.0 00000100:00100000:1.0:1789065819.316096:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257974656:0@lo:400:kworker.0 00000100:00100000:1.0:1789065819.316127:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065819.316152:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065819.316157:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257974784:0@lo:400:kworker.0 00000100:00100000:1.0:1789065819.316177:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065819.317073:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974656 00000100:00100000:2.0:1789065819.317082:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974656 00000100:00100000:2.0:1789065819.317123:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789065819.317131:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257974656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.317186:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257974656:12345-0@lo:400:kworker.0 Request processed in 57us (1059us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065819.318192:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:2.0:1789065819.318583:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbf100 x1875971257974656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065835 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065819.318598:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257974656:0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.318629:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974784 00000100:00100000:2.0:1789065819.318634:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974784 00000100:00100000:2.0:1789065819.318742:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789065819.318749:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257974784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065819.318811:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257974784:12345-0@lo:400:kworker.0 Request processed in 63us (2633us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065819.318817:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789065819.318847:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257974784:0@lo:400:kworker.0 00000100:00100000:0.0:1789065819.319954:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257974272:0@lo:400:kworker.0 00000100:00080000:1.0:1789065819.334025:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065819.558781:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065819.558829:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065819.558864:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065819.558882:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065819.558921:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065819.558946:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919616 00000100:00100000:3.0:1789065819.558966:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919616 00000100:00100000:3.0:1789065819.559031:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919744 00000100:00100000:3.0:1789065819.559034:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919744 00000100:00100000:3.0:1789065819.559059:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1789065819.559069:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235919616:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065819.559141:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235919616:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 73us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065819.559148:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1789065819.559165:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1789065819.559171:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235919744:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065819.559196:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058086c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235919744:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 24us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065819.559201:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:1.0:1789065819.559327:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919360 00000100:00100000:1.0:1789065819.559332:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919360 00000100:00100000:1.0:1789065819.559370:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919488 00000100:00100000:3.0:1789065819.559373:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919232 00000100:00100000:1.0:1789065819.559373:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919488 00000100:00100000:3.0:1789065819.559376:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919232 00000100:00100000:1.0:1789065819.559393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:3.0:1789065819.559397:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:1.0:1789065819.559400:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235919360:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065819.559402:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235919232:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065819.559430:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235919232:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 22us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065819.559436:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:3.0:1789065819.559460:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:3.0:1789065819.559466:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235919488:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065819.570750:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235919360:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 11338us (11968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065819.570766:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00080000:3.0:1789065819.572043:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789065819.572063:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789065819.572066:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065819.574687:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235919488:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 15211us (15793us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065819.574703:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00010000:00010000:1.0:1789065820.144590:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065821.159670:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065822.183614:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065823.222869:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065823.397890:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789065823.397913:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257974912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065823.397993:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065823.398053:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257974912 00000100:00100000:1.0:1789065823.398062:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257974912 00000100:00100000:1.0:1789065823.398129:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789065823.398139:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257974912:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789065823.398142:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789065823.398246:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065823.398302:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257974912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 164us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065823.398309:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1789065823.398403:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbc700 x1875971257974912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065839 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065823.398420:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257974912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065824.238716:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065824.422270:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257975424:0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422339:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065824.422400:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789065824.422406:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257975040:0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422435:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065824.422459:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257975552:0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422481:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065824.422509:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257975296:0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422531:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065824.422567:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789065824.422572:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257975168:0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422595:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065824.422612:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257975680:0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422629:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065824.422655:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975424 00000100:00100000:3.0:1789065824.422662:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975424 00000100:00100000:3.0:1789065824.422715:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975680 00000100:00100000:3.0:1789065824.422718:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975680 00000100:00100000:3.0:1789065824.422748:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789065824.422755:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257975424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422806:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257975424:12345-0@lo:400:kworker.0 Request processed in 51us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.422826:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789065824.422841:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789065824.422847:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257975680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422879:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257975680:12345-0@lo:400:kworker.0 Request processed in 32us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.422885:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789065824.422915:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975040 00000100:00100000:3.0:1789065824.422918:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975040 00000100:00100000:3.0:1789065824.422940:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1789065824.422945:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257975040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065824.422974:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257975040:12345-0@lo:400:kworker.0 Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.422980:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:2.0:1789065824.423502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975552 00000100:00100000:2.0:1789065824.423508:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975552 00000100:00100000:2.0:1789065824.423539:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975296 00000100:00100000:2.0:1789065824.423542:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975296 00000100:00100000:2.0:1789065824.423575:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975168 00000100:00100000:2.0:1789065824.423578:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975168 00000100:00100000:2.0:1789065824.423591:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789065824.423597:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257975552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065824.423644:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257975552:12345-0@lo:400:kworker.0 Request processed in 47us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065824.423651:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789065824.423663:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789065824.423669:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257975296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065824.423693:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257975296:12345-0@lo:400:kworker.0 Request processed in 24us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065824.423711:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789065824.423722:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789065824.423728:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257975168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065824.423751:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257975168:12345-0@lo:400:kworker.0 Request processed in 25us (1157us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065824.423757:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:2.0:1789065824.423794:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789065824.423798:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789065824.423827:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257975040:0@lo:400:kworker.0 00000100:00100000:2.0:1789065824.423841:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257975552:0@lo:400:kworker.0 00010000:00080000:2.0:1789065824.423853:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058001880 x1875971257975424/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065824.423863:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257975424:0@lo:400:kworker.0 00000100:00100000:2.0:1789065824.423915:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058000380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257975168:0@lo:400:kworker.0 00010000:00080000:2.0:1789065824.423925:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058000000 x1875971257975680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065840 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065824.423946:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058000000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257975680:0@lo:400:kworker.0 00000100:00100000:2.0:1789065824.423957:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058003b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257975296:0@lo:400:kworker.0 00000100:00100000:1.0:1789065824.427019:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065824.427039:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257975808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065824.427102:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065824.427146:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975808 00000100:00100000:1.0:1789065824.427153:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975808 00000100:00100000:1.0:1789065824.427200:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789065824.427208:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257975808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065824.427243:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065824.427287:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257975808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065824.427294:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1789065824.427336:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec8a300 x1875971257975808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065840 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065824.427354:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257975808:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065824.681522:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065824.681608:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065824.681638:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065824.681670:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065824.681698:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065824.681729:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920000 00000100:00100000:3.0:1789065824.681739:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920000 00000100:00100000:3.0:1789065824.681797:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920128 00000100:00100000:3.0:1789065824.681801:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920128 00000100:00100000:3.0:1789065824.681824:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:3.0:1789065824.681835:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235920000:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065824.681928:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235920000:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 95us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.681954:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:3.0:1789065824.681973:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:3.0:1789065824.681981:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235920128:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065824.682007:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235920128:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.682013:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:3.0:1789065824.682032:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920256 00000100:00100000:3.0:1789065824.682036:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920256 00000100:00100000:3.0:1789065824.682078:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920384 00000100:00100000:3.0:1789065824.682081:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920384 00000100:00100000:3.0:1789065824.682104:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1789065824.682110:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235920256:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065824.682134:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235920256:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 25us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.682140:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1789065824.682151:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:3.0:1789065824.682158:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235920384:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065824.682179:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235920384:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 22us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065824.682185:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00080000:3.0:1789065824.682200:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789065824.682204:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789065824.682206:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065824.682445:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235919872 00000100:00100000:1.0:1789065824.682450:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235919872 00000100:00100000:1.0:1789065824.682490:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:1.0:1789065824.682498:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235919872:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065824.682537:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235919872:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 40us (897us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065824.682544:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 233 00010000:00010000:1.0:1789065825.253733:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065826.279781:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065827.303400:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065828.327896:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065828.518271:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065828.518298:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257975936:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065828.518369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065828.518465:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257975936 00000100:00100000:2.0:1789065828.518474:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257975936 00000100:00100000:2.0:1789065828.518538:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789065828.518581:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257975936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065828.518619:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065828.518661:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257975936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065828.518668:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00080000:2.0:1789065828.518687:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789065828.518739:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbf100 x1875971257975936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065844 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065828.518758:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257975936:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065829.350586:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065829.542121:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257976320:0@lo:400:kworker.0 00000100:00100000:0.0:1789065829.542190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065829.542309:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789065829.542316:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257976192:0@lo:400:kworker.0 00000100:00100000:0.0:1789065829.542354:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065829.542372:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257976704:0@lo:400:kworker.0 00000100:00100000:0.0:1789065829.542425:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065829.542684:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257976064:0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.542754:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065829.542788:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257976576:0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.542821:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065829.542838:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065829.542843:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257976448:0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.542883:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065829.542914:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976704 00000100:00100000:2.0:1789065829.542921:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976704 00000100:00100000:2.0:1789065829.542972:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976448 00000100:00100000:2.0:1789065829.542976:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976448 00000100:00100000:2.0:1789065829.542998:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789065829.543005:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257976704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.543069:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257976704:12345-0@lo:400:kworker.0 Request processed in 63us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065829.543094:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789065829.543111:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789065829.543131:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257976448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.543204:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257976448:12345-0@lo:400:kworker.0 Request processed in 74us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065829.543221:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1789065829.543238:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789065829.543294:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f480e00 x1875971257976448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065829.543307:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257976448:0@lo:400:kworker.0 00000100:00100000:0.0:1789065829.544057:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976064 00000100:00100000:0.0:1789065829.544066:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976064 00000100:00100000:0.0:1789065829.544116:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1789065829.544136:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257976064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065829.544184:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257976064:12345-0@lo:400:kworker.0 Request processed in 50us (1430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065829.544190:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00010000:00080000:0.0:1789065829.544249:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f481880 x1875971257976704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065845 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065829.544260:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f481880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257976704:0@lo:400:kworker.0 00000100:00100000:3.0:1789065829.544580:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976320 00000100:00100000:3.0:1789065829.544586:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976320 00000100:00100000:3.0:1789065829.544630:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976192 00000100:00100000:3.0:1789065829.544633:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976192 00000100:00100000:3.0:1789065829.544647:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976576 00000100:00100000:3.0:1789065829.544649:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976576 00000100:00100000:3.0:1789065829.544673:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789065829.544680:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257976320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065829.544718:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257976320:12345-0@lo:400:kworker.0 Request processed in 40us (2528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065829.544724:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1789065829.544734:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789065829.544739:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257976192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065829.544759:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257976192:12345-0@lo:400:kworker.0 Request processed in 21us (2406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065829.544764:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789065829.544773:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789065829.544778:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257976576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065829.544815:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257976576:12345-0@lo:400:kworker.0 Request processed in 36us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065829.544821:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789065829.544973:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257976064:0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.544986:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f481180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257976576:0@lo:400:kworker.0 00000100:00080000:0.0:1789065829.545498:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065829.545515:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257976832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065829.545588:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065829.545629:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257976192:0@lo:400:kworker.0 00000100:00100000:0.0:1789065829.545640:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f480700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257976320:0@lo:400:kworker.0 00000100:00100000:2.0:1789065829.545847:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976832 00000100:00100000:2.0:1789065829.545852:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976832 00000100:00100000:2.0:1789065829.545894:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789065829.545901:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257976832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065829.545946:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065829.545997:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257976832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065829.546003:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:0.0:1789065829.547056:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbca80 x1875971257976832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065845 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065829.547089:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257976832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065829.798493:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065829.798569:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065829.798592:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065829.798618:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065829.798658:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065829.798689:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920640 00000100:00100000:0.0:1789065829.798698:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920640 00000100:00100000:0.0:1789065829.798753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920768 00000100:00100000:0.0:1789065829.798755:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920768 00000100:00100000:3.0:1789065829.798924:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:3.0:1789065829.798938:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235920640:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065829.799024:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235920640:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 90us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065829.799032:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:0.0:1789065829.799342:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:0.0:1789065829.799363:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235920768:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065829.799402:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235920768:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 41us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065829.799410:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:0.0:1789065829.799432:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920896 00000100:00100000:0.0:1789065829.799436:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920896 00000100:00100000:0.0:1789065829.799462:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921024 00000100:00100000:0.0:1789065829.799465:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921024 00000100:00100000:0.0:1789065829.799488:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1789065829.799495:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2346:x1875971235920896:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:0.0:1789065829.799514:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c826ac 00000100:00100000:2.0:1789065829.799716:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235920512 00000100:00100000:2.0:1789065829.799721:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235920512 00000100:00100000:2.0:1789065829.799750:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 235 00000100:00100000:2.0:1789065829.799757:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235920512:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065829.799806:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235920512:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 38us (1247us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065829.799812:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 235 00000100:00080000:0.0:1789065829.800081:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf07f178000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789065829.800124:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789065829.800445:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+2:2346:x1875971235920896:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 949us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065829.800466:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1789065829.800482:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1789065829.800490:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2346:x1875971235921024:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:0.0:1789065829.800505:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c826b3 00000100:00080000:0.0:1789065829.800510:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf07f17b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789065829.802510:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1789065829.802933:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+2:2346:x1875971235921024:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 2437us (4266us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065829.802945:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00080000:0.0:1789065829.802982:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789065829.802987:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789065829.803004:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789065829.812136:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065829.818404:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065830.377058:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065831.401224:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065832.423757:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065833.450799:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065833.638985:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257976960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065833.639058:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065833.643619:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257976960 00000100:00100000:2.0:1789065833.643763:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257976960 00000100:00100000:2.0:1789065833.645890:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789065833.645908:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257976960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065833.645950:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065833.646043:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257976960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (6985us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065833.646050:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1789065833.647599:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edd2d80 x1875971257976960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065849 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065833.647634:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257976960:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789065833.649289:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:2.0:1789065833.678131:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 59a5cafc-7436-4bd4-96e7-6564036805b9 00000020:00000080:2.0:1789065833.678141:0:6711:0:(genops.c:885:class_export_put()) final put ffff9cf07f17e000/59a5cafc-7436-4bd4-96e7-6564036805b9 00000020:00000080:1.0:1789065833.678219:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17e000/59a5cafc-7436-4bd4-96e7-6564036805b9 for lustre-OST0000 00000020:00000080:1.0:1789065833.678279:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07f178000 for lustre-OST0000 00000001:00100000:1.0:1789065834.202265:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 59a5cafc-7436-4bd4-96e7-6564036805b9 00000020:00000080:1.0:1789065834.202276:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cf07f17b000/59a5cafc-7436-4bd4-96e7-6564036805b9 00000020:00000080:1.0:1789065834.202305:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17b000/59a5cafc-7436-4bd4-96e7-6564036805b9 for lustre-OST0001 00000020:00000080:1.0:1789065834.202356:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07f17b800 for lustre-OST0001 00010000:00010000:2.0:1789065834.476151:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065834.666070:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257977088:0@lo:400:kworker.0 00000100:00100000:1.0:1789065834.666146:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065834.666211:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257977600:0@lo:400:kworker.0 00000100:00100000:1.0:1789065834.666238:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065834.666272:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789065834.666277:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257977472:0@lo:400:kworker.0 00000100:00100000:1.0:1789065834.666301:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065834.666328:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257977216:0@lo:400:kworker.0 00000100:00100000:1.0:1789065834.666349:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065834.666364:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257977728:0@lo:400:kworker.0 00000100:00100000:1.0:1789065834.666392:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065834.666409:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065834.666414:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257977344:0@lo:400:kworker.0 00000100:00100000:1.0:1789065834.666435:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065834.666587:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977600 00000100:00100000:3.0:1789065834.666595:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977600 00000100:00100000:3.0:1789065834.666651:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977216 00000100:00100000:3.0:1789065834.666654:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977216 00000100:00100000:3.0:1789065834.666676:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977344 00000100:00100000:3.0:1789065834.666679:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977344 00000100:00100000:3.0:1789065834.666696:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789065834.666715:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257977600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065834.666779:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257977600:12345-0@lo:400:kworker.0 Request processed in 66us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065834.666787:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1789065834.666804:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789065834.666811:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257977216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065834.666843:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257977216:12345-0@lo:400:kworker.0 Request processed in 33us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065834.666849:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1789065834.666861:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789065834.666867:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257977344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065834.666893:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257977344:12345-0@lo:400:kworker.0 Request processed in 27us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065834.666899:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789065834.666937:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec88e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257977600:0@lo:400:kworker.0 00000100:00100000:3.0:1789065834.666973:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257977344:0@lo:400:kworker.0 00000100:00100000:3.0:1789065834.666984:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec88700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257977216:0@lo:400:kworker.0 00000100:00100000:2.0:1789065834.668434:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977088 00000100:00100000:2.0:1789065834.668443:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977088 00000100:00100000:2.0:1789065834.668486:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789065834.668503:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257977088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065834.668596:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257977088:12345-0@lo:400:kworker.0 Request processed in 95us (2450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065834.668604:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789065834.668646:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065834.668659:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257977856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065834.668690:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065834.668739:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977856 00000100:00100000:2.0:1789065834.668744:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977856 00000100:00100000:2.0:1789065834.668776:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789065834.668784:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257977856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065834.668816:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065834.668851:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257977856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065834.668857:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789065834.668893:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257977088:0@lo:400:kworker.0 00010000:00080000:2.0:1789065834.668921:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edbca80 x1875971257977856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065850 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065834.668938:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257977856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065834.669029:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977472 00000100:00100000:0.0:1789065834.669035:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977472 00000100:00100000:0.0:1789065834.669069:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977728 00000100:00100000:0.0:1789065834.669073:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977728 00000100:00100000:0.0:1789065834.669092:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789065834.669099:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257977472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065834.669138:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257977472:12345-0@lo:400:kworker.0 Request processed in 40us (2836us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065834.669144:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789065834.669157:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1789065834.669163:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257977728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065834.669206:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257977728:12345-0@lo:400:kworker.0 Request processed in 43us (2812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065834.669212:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:0.0:1789065834.669235:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789065834.669239:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789065834.669263:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec89880 x1875971257977472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065834.669273:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257977472:0@lo:400:kworker.0 00010000:00080000:0.0:1789065834.669295:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07fd21180 x1875971257977728/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065850 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065834.669302:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257977728:0@lo:400:kworker.0 00000100:00100000:0.0:1789065834.919067:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065834.919128:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065834.919173:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065834.919265:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921408 00000100:00100000:1.0:1789065834.919275:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921408 00000100:00100000:1.0:1789065834.919348:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921280 00000100:00100000:1.0:1789065834.919351:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921280 00000100:00100000:1.0:1789065834.919376:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:1.0:1789065834.919387:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235921408:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065834.919462:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235921408:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 77us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065834.919474:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:1.0:1789065834.919823:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:1.0:1789065834.919833:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235921280:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065834.919869:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235921280:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 38us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065834.919880:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00080000:0.0:1789065834.920178:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065834.920404:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921152 00000100:00100000:2.0:1789065834.920410:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921152 00000100:00100000:2.0:1789065834.920588:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:2.0:1789065834.920598:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235921152:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065834.920646:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235921152:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 51us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065834.920676:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 237 00010000:00010000:0.0:1789065835.497160:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065836.520684:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065837.541887:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065837.855198:0:11013:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789065838.566386:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065838.761240:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065838.761268:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257977984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065838.761344:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065838.763314:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257977984 00000100:00100000:3.0:1789065838.763329:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257977984 00000100:00100000:3.0:1789065838.763447:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789065838.763458:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257977984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065838.763538:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065838.763659:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257977984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 202us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065838.763667:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1789065838.763984:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789065838.764236:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07edd3b80 x1875971257977984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065838.764255:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257977984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065839.590157:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065839.782954:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257978496:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783025:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.783083:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789065839.783090:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257978112:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783128:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.783152:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257978624:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783174:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.783199:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257978240:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783220:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.783529:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257978752:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783582:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.783614:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065839.783620:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257978368:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783642:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.783672:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978496 00000100:00100000:1.0:1789065839.783680:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978496 00000100:00100000:1.0:1789065839.783721:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978752 00000100:00100000:1.0:1789065839.783724:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978752 00000100:00100000:1.0:1789065839.783755:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789065839.783763:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257978496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783812:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257978496:12345-0@lo:400:kworker.0 Request processed in 50us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.783819:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789065839.783836:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789065839.783842:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257978752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783872:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257978752:12345-0@lo:400:kworker.0 Request processed in 30us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.783877:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789065839.783894:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978112 00000100:00100000:1.0:1789065839.783898:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978112 00000100:00100000:1.0:1789065839.783933:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789065839.783939:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257978112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.783969:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257978112:12345-0@lo:400:kworker.0 Request processed in 31us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.783976:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789065839.783998:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978624 00000100:00100000:1.0:1789065839.784002:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978624 00000100:00100000:1.0:1789065839.784024:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978240 00000100:00100000:1.0:1789065839.784028:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978240 00000100:00100000:1.0:1789065839.784036:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978368 00000100:00100000:1.0:1789065839.784038:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978368 00000100:00100000:1.0:1789065839.784050:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789065839.784055:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257978624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.784085:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257978624:12345-0@lo:400:kworker.0 Request processed in 30us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.784090:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789065839.784100:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789065839.784105:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257978240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.784129:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257978240:12345-0@lo:400:kworker.0 Request processed in 23us (908us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.784134:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789065839.784143:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789065839.784148:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257978368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.784170:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257978368:12345-0@lo:400:kworker.0 Request processed in 22us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.784175:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:1.0:1789065839.784197:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789065839.784207:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065839.785757:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257978112:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.785795:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257978624:0@lo:400:kworker.0 00010000:00080000:1.0:1789065839.785809:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf05f3bd180 x1875971257978496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065839.785819:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257978496:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.785873:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257978368:0@lo:400:kworker.0 00000100:00100000:1.0:1789065839.785882:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257978240:0@lo:400:kworker.0 00010000:00080000:1.0:1789065839.785893:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf05f3bf800 x1875971257978752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065855 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065839.785902:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257978752:0@lo:400:kworker.0 00000100:00100000:3.0:1789065839.788002:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065839.788024:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257978880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065839.788092:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065839.788206:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257978880 00000100:00100000:1.0:1789065839.788213:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257978880 00000100:00100000:1.0:1789065839.788275:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789065839.788283:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257978880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065839.788317:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065839.788367:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257978880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065839.788374:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:3.0:1789065839.788447:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf05f3bf800 x1875971257978880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065855 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065839.788464:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257978880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065840.036471:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065840.036524:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065840.036619:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065840.036648:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921664 00000100:00100000:3.0:1789065840.036657:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921664 00000100:00100000:3.0:1789065840.036710:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921792 00000100:00100000:3.0:1789065840.036714:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921792 00000100:00100000:3.0:1789065840.036736:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:3.0:1789065840.036746:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235921664:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065840.036836:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235921664:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 92us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065840.036844:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:3.0:1789065840.036862:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:3.0:1789065840.036869:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235921792:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065840.036906:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235921792:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 38us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065840.036912:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00080000:3.0:1789065840.036928:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065840.037226:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921536 00000100:00100000:2.0:1789065840.037232:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921536 00000100:00100000:2.0:1789065840.037268:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 239 00000100:00100000:2.0:1789065840.037275:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235921536:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065840.037305:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235921536:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 32us (846us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065840.037311:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 239 00010000:00010000:2.0:1789065840.614066:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065841.637887:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789065842.636294:0:11163:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeeed54620 20000000:00000080:0.0:1789065842.636312:0:11163:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf050f36000 uarg=0000000000000000 20000000:01000000:0.0:1789065842.636361:0:11163:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789065842.636368:0:11163:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1789065842.636373:0:11163:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789065842.641297:0:11164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1789065842.644464:0:11163:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789065842.661446:0:11163:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789065842.663524:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065842.665725:0:11163:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665754:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665776:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8265f expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665782:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82674 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665790:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82682 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665796:0:11163:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665803:0:11163:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665847:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 12 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.665865:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 12 pid: 5832 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.665880:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979008:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065842.665998:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82682 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.666007:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82682 expref: 18 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.666017:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979136:0@lo:104: 00000100:00100000:1.0:1789065842.666061:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789065842.666147:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c82674 expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.666155:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c82674 expref: 18 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.666163:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979264:0@lo:104: 00000100:00100000:1.0:1789065842.666185:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789065842.670363:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8265f expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.670382:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8265f expref: 18 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.670395:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979392:0@lo:104: 00000100:00100000:1.0:1789065842.670449:0:11163:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065842.674123:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065842.674162:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235921920 00000100:00100000:3.0:1789065842.674172:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235921920 00010000:00010000:3.0:1789065842.674210:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 13 pid: 5832 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065842.674244:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1789065842.674253:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235921920:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065842.674267:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065842.674273:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 13 pid: 5832 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065842.674285:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 13 pid: 5832 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065842.674307:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065842.674368:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e0a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235921920:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 116us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065842.674375:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1789065842.675227:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257979136 00000100:00100000:0.0:1789065842.675236:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257979136 00000100:00100000:0.0:1789065842.675274:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257979264 00000100:00100000:0.0:1789065842.675277:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257979264 00000100:00100000:0.0:1789065842.675290:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065842.675297:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:11163:x1875971257979136:12345-0@lo:104: 00010000:00010000:0.0:1789065842.675311:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675488:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065842.675495:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:11163:x1875971257979136:12345-0@lo:104: Request processed in 198us (9434us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065842.675501:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065842.675527:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789065842.675534:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:11163:x1875971257979264:12345-0@lo:104: 00010000:00010000:0.0:1789065842.675584:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675621:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789065842.675627:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:11163:x1875971257979264:12345-0@lo:104: Request processed in 94us (9441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065842.675632:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:0.0:1789065842.675653:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789065842.675659:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675666:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065842.675671:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675679:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065842.675686:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065842.675691:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065842.675725:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675731:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065842.675753:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675760:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031000/0x7555615576c82682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c82689 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675779:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065842.675783:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675787:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030c00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065842.675790:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675797:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065842.675803:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065842.675808:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065842.675821:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675826:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065842.675832:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675838:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040030c00/0x7555615576c82674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8267b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.675847:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065842.675848:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065842.675849:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065842.675863:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257979520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065842.675904:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065842.675941:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065842.675947:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257979648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065842.675966:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065842.675994:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257979520 00000100:00100000:0.0:1789065842.675999:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257979520 00010000:00010000:0.0:1789065842.676017:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82682 expref: 19 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065842.676035:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257979648 00000100:00100000:0.0:1789065842.676038:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257979648 00010000:00010000:0.0:1789065842.676048:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82674 expref: 20 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065842.676064:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065842.676070:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+20:3297:x1875971257979520:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065842.676079:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065842.676084:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82682 expref: 20 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.676093:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82682 expref: 20 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.676106:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065842.676132:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+20:3297:x1875971257979520:12345-0@lo:103:ldlm_bl.0 Request processed in 62us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065842.676139:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065842.676150:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065842.676156:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257979648:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065842.676170:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065842.676174:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c82674 expref: 19 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.676181:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c82674 expref: 19 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.676190:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065842.676211:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257979648:12345-0@lo:103:ldlm_bl.0 Request processed in 55us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065842.676216:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065842.676254:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257979648:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065842.676262:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257979520:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789065842.676334:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065842.679844:0:11163:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 12 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.679867:0:11163:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 12 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.679882:0:11163:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979776:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065842.679954:0:11163:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7cc0 going to sleep for 11 seconds 00010000:00010000:1.0:1789065842.679978:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821ffa00/0x7555615576c8269e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbe0 expref: 12 pid: 5832 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.679992:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bfb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979008:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065842.680024:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030a00/0x7555615576c82689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82682 expref: 18 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.680036:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979136:0@lo:104: 00010000:00010000:1.0:1789065842.680045:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040031a00/0x7555615576c8267b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c82674 expref: 17 pid: 5832 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.680053:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979264:0@lo:104: 00000100:00100000:0.0:1789065842.682530:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257979392 00000100:00100000:0.0:1789065842.683438:0:5822:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257979392 00000100:00100000:0.0:1789065842.683497:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789065842.683508:0:5822:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:11163:x1875971257979392:12345-0@lo:104: 00010000:00010000:0.0:1789065842.683526:0:5822:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.683651:0:5822:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065842.683658:0:5822:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:11163:x1875971257979392:12345-0@lo:104: Request processed in 152us (13208us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065842.683665:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789065842.683688:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065842.683694:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.683718:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065842.683722:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.683729:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065842.683736:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065842.683741:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065842.683776:0:5827:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.683783:0:5827:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065842.683809:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.683815:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf06b073200/0x7555615576c8265f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8266d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.683833:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065842.683836:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065842.683837:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065842.683851:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257979904:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065842.683889:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065842.683938:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257979904 00000100:00100000:0.0:1789065842.683943:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257979904 00010000:00010000:0.0:1789065842.683960:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8265f expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065842.683989:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789065842.683995:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3295:x1875971257979904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065842.684006:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065842.684011:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8265f expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.684021:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8265f expref: 17 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065842.684035:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065842.684061:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3295:x1875971257979904:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065842.684066:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789065842.684102:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257979904:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789065842.684200:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072800/0x7555615576c8266d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8265f expref: 16 pid: 5831 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.684213:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979392:0@lo:104: 00000100:00100000:3.0:1789065842.689734:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065842.690626:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922048 00000100:00100000:2.0:1789065842.690638:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922048 00010000:00010000:2.0:1789065842.690678:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 12 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065842.690716:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:2.0:1789065842.690725:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:2347:x1875971235922048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065842.690740:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065842.690758:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 12 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690769:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 12 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690792:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690800:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690816:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690823:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690828:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690835:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690840:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065842.690845:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690853:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690862:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065842.690879:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065842.690933:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:2347:x1875971235922048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 208us (1209us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065842.690941:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00010000:00010000:1.0:1789065842.691756:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073800/0x7555615576c82666 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba8 expref: 11 pid: 5831 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065842.691774:0:11163:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11163:1875971257979776:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065842.691809:0:11163:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.691818:0:11163:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.691824:0:11163:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065842.691829:0:11163:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072a00/0x7555615576c826ba lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.685881:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065843.810095:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065843.810201:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922176 00000100:00100000:0.0:1789065843.810210:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922176 00000100:00100000:0.0:1789065843.810265:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 240 00000100:00100000:0.0:1789065843.810275:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:5595:x1875971235922176:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065843.810291:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065843.810310:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc0a expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.810348:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.810359:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.810403:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fee00, rc 0) 00000100:00100000:0.0:1789065843.810470:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235922176:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 197us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065843.810477:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 240 00000100:00100000:2.0:1789065843.824061:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065843.824144:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922304 00000100:00100000:0.0:1789065843.824155:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922304 00000100:00100000:0.0:1789065843.824210:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 241 00000100:00100000:0.0:1789065843.824220:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235922304:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065843.824518:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235922304:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 297us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065843.824535:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 241 00000100:00100000:0.0:1789065843.831638:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065843.831693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922432 00000100:00100000:3.0:1789065843.831702:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922432 00000100:00100000:3.0:1789065843.831772:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 242 00000100:00100000:3.0:1789065843.831782:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235922432:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.832003:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235922432:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 221us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.832011:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 242 00000100:00100000:3.0:1789065843.838007:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065843.838154:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922560 00000100:00100000:0.0:1789065843.838333:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922560 00000100:00100000:0.0:1789065843.838442:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 243 00000100:00100000:0.0:1789065843.838454:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235922560:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065843.838470:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065843.838487:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc11 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.838514:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.838524:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.838578:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fea00, rc 0) 00000100:00100000:0.0:1789065843.838654:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235922560:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 202us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065843.838660:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 243 00000100:00100000:3.0:1789065843.844365:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065843.844521:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922688 00000100:00100000:2.0:1789065843.844542:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922688 00000100:00100000:2.0:1789065843.844618:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 244 00000100:00100000:2.0:1789065843.844630:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235922688:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065843.844923:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235922688:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 296us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065843.844931:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 244 00000100:00100000:2.0:1789065843.854077:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065843.854156:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922816 00000100:00100000:3.0:1789065843.854165:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922816 00000100:00100000:3.0:1789065843.854218:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 245 00000100:00100000:3.0:1789065843.854229:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235922816:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.854461:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235922816:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 233us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.854470:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 245 00000100:00100000:2.0:1789065843.878101:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257980032:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065843.878174:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065843.878287:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980032 00000100:00100000:3.0:1789065843.878296:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980032 00000100:00100000:3.0:1789065843.878414:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789065843.878424:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257980032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065843.878458:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065843.878508:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257980032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (334us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.878515:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1789065843.878965:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f483800 x1875971257980032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065843.878991:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257980032:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789065843.879086:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 10000000:01000000:1.0:1789065843.941673:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789065843.941681:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf081779000 from 7 10000000:01000000:1.0:1789065843.941686:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789065843.941735:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.941747:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.941758:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065843.941782:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980160:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.941856:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.941910:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065843.942297:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980160 00000100:00100000:0.0:1789065843.942305:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980160 00000100:00100000:2.0:1789065843.943304:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:2.0:1789065843.943321:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257980160:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065843.943337:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065843.943353:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c826cf expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065843.943380:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c826cf expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065843.943391:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c826cf expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065843.943414:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ca00, rc 0) 00000100:00100000:2.0:1789065843.943482:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257980160:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065843.943499:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1789065843.943613:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980160:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065843.943630:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.943639:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065843.943704:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.943737:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.948990:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065843.950713:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980288 00000100:00100000:3.0:1789065843.950728:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980288 00000100:00100000:3.0:1789065843.950798:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1789065843.950810:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257980288:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.952565:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257980288:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1733us (8803us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.952579:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789065843.953370:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980288:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.953444:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980416:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.953502:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.953593:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065843.953859:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980416 00000100:00100000:2.0:1789065843.953866:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980416 00000100:00100000:2.0:1789065843.953911:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:2.0:1789065843.953920:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257980416:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065843.954544:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257980416:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 623us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065843.954576:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1789065843.955152:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980416:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789065843.957090:0:11183:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789065843.957304:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789065843.957325:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789065843.957338:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.957351:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789065843.957362:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789065843.957695:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07a795800 from 7 10000000:01000000:1.0:1789065843.957700:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789065843.957739:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.957748:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.957760:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065843.957908:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.957978:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.958055:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd70c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065843.958101:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980544 00000100:00100000:3.0:1789065843.958109:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980544 00000100:00100000:3.0:1789065843.958159:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1789065843.958168:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257980544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065843.958183:0:5831:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065843.958196:0:5831:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c826dd expref: -99 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065843.958221:0:5831:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c826dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065843.958232:0:5831:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c826dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065843.958241:0:5831:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041682400, rc 0) 00000100:00100000:3.0:1789065843.958344:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257980544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 176us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.958352:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:1.0:1789065843.958677:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065843.958693:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.958715:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065843.958840:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.958873:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.958959:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd70c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065843.959002:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980672 00000100:00100000:2.0:1789065843.959009:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980672 00000100:00100000:2.0:1789065843.959084:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1789065843.959093:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257980672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065843.959961:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257980672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 866us (1083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065843.959972:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789065843.960253:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3be300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.960297:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980800:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.960424:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065843.960516:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07a8ee540 going to sleep for 11 seconds 00000100:00100000:2.0:1789065843.961044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980800 00000100:00100000:2.0:1789065843.961052:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980800 00000100:00100000:2.0:1789065843.961135:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789065843.961144:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257980800:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065843.961336:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257980800:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 193us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065843.961344:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789065843.961636:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980800:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789065843.964036:0:11184:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1789065843.964713:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1789065843.964737:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789065843.964748:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.964770:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789065843.964782:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789065843.964784:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf04c2a4800 from 7 10000000:01000000:1.0:1789065843.964787:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789065843.964824:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.964832:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.964843:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065843.964867:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980928:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.964929:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.964993:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065843.965104:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257980928 00000100:00100000:3.0:1789065843.965111:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257980928 00000100:00100000:3.0:1789065843.965148:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789065843.965156:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257980928:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065843.965169:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065843.965183:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c826eb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065843.965205:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c826eb expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065843.965215:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c826eb expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065843.965223:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030c00, rc 0) 00000100:00100000:3.0:1789065843.965273:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257980928:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.965280:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1789065843.965899:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257980928:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065843.965917:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065843.965926:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065843.965984:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257981056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.966016:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.966047:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065843.966103:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981056 00000100:00100000:3.0:1789065843.966108:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981056 00000100:00100000:3.0:1789065843.966129:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1789065843.966136:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257981056:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.966544:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257981056:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.966583:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789065843.966910:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257981056:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.966945:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257981184:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065843.966986:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065843.967006:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065843.968021:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981184 00000100:00100000:3.0:1789065843.968032:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981184 00000100:00100000:3.0:1789065843.968068:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1789065843.968076:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257981184:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065843.968265:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257981184:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 190us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065843.968272:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:0.0:1789065843.973201:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bdf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257981184:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789065843.973884:0:11185:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1789065843.973939:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1789065843.973957:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789065843.973968:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065843.973979:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065844.709785:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065844.902062:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789065844.902089:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257981312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065844.902158:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065844.902335:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981312 00000100:00100000:0.0:1789065844.902344:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981312 00000100:00100000:0.0:1789065844.902410:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789065844.902420:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257981312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065844.902458:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065844.902504:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257981312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065844.902522:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:2.0:1789065844.902538:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1789065844.903928:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf05f3bd180 x1875971257981312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065860 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065844.905052:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257981312:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065844.905453:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257981568:0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.905526:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065844.906035:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065844.906043:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257981696:0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.906073:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065844.906113:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981568 00000100:00100000:3.0:1789065844.906120:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981568 00000100:00100000:3.0:1789065844.906155:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981696 00000100:00100000:3.0:1789065844.906157:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981696 00000100:00100000:3.0:1789065844.906188:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789065844.906196:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257981568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.906245:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257981568:12345-0@lo:400:kworker.0 Request processed in 50us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065844.906253:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789065844.906269:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789065844.906275:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257981696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.906303:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257981696:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065844.906309:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789065844.906350:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257981696:0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.906372:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257981568:0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.906467:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257981824:0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.906501:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065844.906589:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789065844.906597:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257981440:0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.906625:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065844.906649:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257981952:0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.906670:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789065844.906695:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065844.906706:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981440 00000100:00100000:2.0:1789065844.906709:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981440 00000100:00100000:2.0:1789065844.906737:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789065844.906743:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257981440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.907028:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050af9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257981440:12345-0@lo:400:kworker.0 Request processed in 283us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065844.907035:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789065844.907063:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981952 00000100:00100000:2.0:1789065844.907067:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981952 00000100:00100000:2.0:1789065844.907095:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789065844.907100:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257981952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.907127:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257981952:12345-0@lo:400:kworker.0 Request processed in 27us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065844.907132:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:2.0:1789065844.907149:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065844.907165:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257981440:0@lo:400:kworker.0 00000100:00100000:2.0:1789065844.907174:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257981952:0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.907696:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257981824 00000100:00100000:3.0:1789065844.907701:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257981824 00000100:00100000:3.0:1789065844.907785:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789065844.907793:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257981824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065844.907842:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257981824:12345-0@lo:400:kworker.0 Request processed in 50us (1341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065844.907848:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1789065844.907904:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec89880 x1875971257981824/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065860 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065844.907915:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec89880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257981824:0@lo:400:kworker.0 00000100:00100000:3.0:1789065845.155389:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065845.155461:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065845.155512:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065845.155574:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923072 00000100:00100000:0.0:1789065845.155581:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923200 00000100:00100000:3.0:1789065845.155584:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923072 00000100:00100000:0.0:1789065845.155588:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923200 00000100:00100000:2.0:1789065845.155607:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235922944 00000100:00100000:2.0:1789065845.155614:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235922944 00000100:00100000:2.0:1789065845.155666:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 256 00000100:00100000:3.0:1789065845.155675:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:2.0:1789065845.155680:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235922944:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065845.155689:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235923072:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065845.155769:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235923072:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 84us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065845.155776:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:2.0:1789065845.156043:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235922944:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 366us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065845.156051:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 256 00000100:00100000:0.0:1789065845.156200:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:0.0:1789065845.156210:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235923200:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065845.156434:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235923200:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 215us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065845.156444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00080000:2.0:1789065845.156722:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789065845.737467:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065846.758803:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065847.168732:0:11360:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789065847.783237:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065848.806197:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065848.998385:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257982080:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065848.998500:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065848.998640:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982080 00000100:00100000:2.0:1789065848.998649:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982080 00000100:00100000:2.0:1789065848.998703:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789065848.998712:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257982080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065848.998793:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789065848.998888:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065848.999476:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257982080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 763us (974us total) trans 0 rc 0/0 00010000:00080000:1.0:1789065848.999484:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec8a300 x1875971257982080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065864 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065848.999490:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789065848.999511:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257982080:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065849.831889:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065850.021888:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257982208:0@lo:400:kworker.0 00000100:00100000:1.0:1789065850.021967:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065850.022133:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982208 00000100:00100000:0.0:1789065850.022145:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982208 00000100:00100000:0.0:1789065850.023080:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1789065850.023093:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257982208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.024048:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257982336:0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.024101:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065850.024140:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065850.024147:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257982464:0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.024168:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065850.024990:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257982592:0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.025028:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065850.025067:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982336 00000100:00100000:2.0:1789065850.025074:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982336 00000100:00100000:2.0:1789065850.025118:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982464 00000100:00100000:2.0:1789065850.025121:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982464 00000100:00100000:2.0:1789065850.025152:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1789065850.025162:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257982336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065850.025252:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065850.025264:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257982848:0@lo:400:kworker.0 00000100:00100000:3.0:1789065850.025312:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065850.025350:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982592 00000100:00100000:3.0:1789065850.025361:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982592 00000100:00100000:3.0:1789065850.025395:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982848 00000100:00100000:3.0:1789065850.025399:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982848 00000100:00100000:2.0:1789065850.025405:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257982336:12345-0@lo:400:kworker.0 Request processed in 244us (1302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065850.025427:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1789065850.025442:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789065850.025452:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789065850.025463:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257982464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065850.025468:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257982592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.025518:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257982464:12345-0@lo:400:kworker.0 Request processed in 55us (1347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065850.025527:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1789065850.025532:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257982592:12345-0@lo:400:kworker.0 Request processed in 57us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065850.025541:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789065850.025571:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789065850.025580:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257982848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.025696:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257982848:12345-0@lo:400:kworker.0 Request processed in 117us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065850.025702:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1789065850.025810:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ae64e00 x1875971257982848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065850.025824:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257982848:0@lo:400:kworker.0 00000100:00080000:2.0:1789065850.026076:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789065850.026081:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789065850.026083:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065850.026848:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257982464:0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.026875:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f482a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257982336:0@lo:400:kworker.0 00010000:00080000:2.0:1789065850.027500:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf0818dbb80 x1875971257982592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065866 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065850.027513:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257982592:0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.027526:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065850.027534:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257982720:0@lo:400:kworker.0 00000100:00100000:2.0:1789065850.027618:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065850.027669:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982720 00000100:00100000:3.0:1789065850.027679:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982720 00000100:00100000:3.0:1789065850.027743:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1789065850.027751:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257982720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065850.027797:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257982720:12345-0@lo:400:kworker.0 Request processed in 47us (179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065850.027803:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00080000:2.0:1789065850.027855:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065850.027889:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae66d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257982720:0@lo:400:kworker.0 00000100:00100000:1.0:1789065850.028039:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257982208:0@lo:400:kworker.0 00000100:00100000:0.0:1789065850.028040:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257982208:12345-0@lo:400:kworker.0 Request processed in 4950us (6072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065850.028050:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789065850.028118:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf05f3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257982976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065850.028176:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065850.028488:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257982976 00000100:00100000:0.0:1789065850.028493:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257982976 00000100:00100000:0.0:1789065850.037676:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789065850.037697:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257982976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065850.037749:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065850.037854:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257982976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 165us (9676us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065850.037862:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:0.0:1789065850.037923:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf05f3bc700 x1875971257982976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065850.037945:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf05f3bc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257982976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065850.278527:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065850.278576:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065850.278597:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065850.278623:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923584 00000100:00100000:1.0:1789065850.278632:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923584 00000100:00100000:1.0:1789065850.278682:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923456 00000100:00100000:1.0:1789065850.278684:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923456 00000100:00100000:1.0:1789065850.278720:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:1.0:1789065850.278730:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971235923584:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065850.278805:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971235923584:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065850.278812:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:1.0:1789065850.278831:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:1.0:1789065850.278838:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2349:x1875971235923456:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065850.278863:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2349:x1875971235923456:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065850.278869:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:2.0:1789065850.279297:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923328 00000100:00100000:2.0:1789065850.279302:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923328 00000100:00100000:2.0:1789065850.279346:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 258 00000100:00100000:2.0:1789065850.279353:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235923328:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065850.279401:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235923328:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (885us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065850.279418:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 258 00000100:00080000:2.0:1789065850.279449:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789065850.854462:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065851.881153:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065852.243402:0:11460:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 14:44:09 (1789065849) === 00000100:00100000:1.0:1789065852.734295:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065852.734392:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065852.734762:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923840 00000100:00100000:2.0:1789065852.734771:0:5847:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923840 00000100:00100000:2.0:1789065852.734843:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:2.0:1789065852.734855:0:5847:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:9688:x1875971235923840:12345-192.168.204.23@tcp:700:mkdir.0 00000100:00100000:3.0:1789065852.735101:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235923712 00000100:00100000:3.0:1789065852.735107:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235923712 00000100:00100000:3.0:1789065852.735142:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1789065852.735150:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235923712:12345-192.168.204.23@tcp:41:mkdir.0 00000004:00000024:3.0:1789065852.735181:0:8255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1789065852.735278:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235923712:12345-192.168.204.23@tcp:41:mkdir.0 Request processed in 127us (990us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065852.735285:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:2.0:1789065852.736369:0:5847:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:9688:x1875971235923840:12345-192.168.204.23@tcp:700:mkdir.0 Request processed in 1501us (1959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065852.736380:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00080000:0.0:1789065852.736465:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065852.745814:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065852.751111:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235924096 00000100:00100000:0.0:1789065852.751131:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235924096 00000100:00100000:0.0:1789065852.751230:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:0.0:1789065852.751242:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:9688:x1875971235924096:12345-192.168.204.23@tcp:36:mkdir.0 00010000:00010000:0.0:1789065852.751310:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065852.751414:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c825da lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb93 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.751447:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:0.0:1789065852.751460:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065852.751891:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.751906:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.751916:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.751945:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.751953:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.751960:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065852.753196:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789065852.753210:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.753226:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.753233:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.753240:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065852.753245:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.753253:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.753267:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:0.0:1789065852.753270:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065852.753274:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.753280:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c826f9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065852.753299:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000497c3fef reply state 00000000240f4a5d transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065852.753308:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065852.753425:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9688:x1875971235924096:12345-192.168.204.23@tcp:36:mkdir.0 Request processed in 2181us (8102us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1789065852.753433:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00010000:00010000:3.0:1789065852.756624:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.756656:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.756664:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.756670:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffa00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065852.756675:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.756683:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.756701:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065852.756704:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065852.756709:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.756715:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82700 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065852.770823:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065852.771146:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235924224 00000100:00100000:3.0:1789065852.771157:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235924224 00000100:00100000:3.0:1789065852.771217:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1789065852.771228:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:9690:x1875971235924224:12345-192.168.204.23@tcp:101:chmod.0 00010000:00010000:3.0:1789065852.771253:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065852.771277:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031a00/0x7555615576c82707 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc18 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.771375:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c8270e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.771388:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c8270e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.771400:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c8270e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065852.771438:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789065852.771442:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065852.771479:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c8270e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.771504:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031a00/0x7555615576c82707 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc18 expref: 8 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.771521:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c8270e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc18 expref: 7 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065852.771529:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065852.771531:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789065852.771535:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031000, rc 0) 00000100:00100000:3.0:1789065852.771835:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9690:x1875971235924224:12345-192.168.204.23@tcp:101:chmod.0 Request processed in 607us (1021us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065852.771842:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1789065852.783930:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065852.784120:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235924480 00000100:00100000:0.0:1789065852.784131:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235924480 00000100:00100000:0.0:1789065852.784218:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:0.0:1789065852.784228:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9690:x1875971235924480:12345-192.168.204.23@tcp:36:chmod.0 00010000:00010000:0.0:1789065852.784293:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065852.784336:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c8270e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc18 expref: 7 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.784367:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:0.0:1789065852.784379:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065852.784411:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.784425:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.784435:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065852.784782:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000b247393a reply state 00000000456f65c9 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065852.784794:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789065852.784801:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789065852.784897:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:9690:x1875971235924480:12345-192.168.204.23@tcp:36:chmod.0 Request processed in 669us (975us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789065852.784905:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00010000:00010000:1.0:1789065852.790580:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065852.790608:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065852.790617:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065852.790623:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065852.790628:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065852.790637:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065852.790657:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:1.0:1789065852.790673:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789065852.790679:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065852.790684:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82715 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065852.828898:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065852.829001:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235924608 00000100:00100000:2.0:1789065852.829012:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235924608 00000100:00100000:2.0:1789065852.829078:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1789065852.829091:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9691:x1875971235924608:12345-192.168.204.23@tcp:101:chown.0 00010000:00010000:2.0:1789065852.829114:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065852.829138:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8271c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc1f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.829212:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c82723 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.829226:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c82723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.829240:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c82723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065852.829278:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789065852.829282:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065852.829318:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c82723 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.829346:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8271c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc1f expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.829376:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c82723 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc1f expref: 8 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.829384:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f200) 00010000:00010000:2.0:1789065852.829401:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065852.829997:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789065852.830072:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:9691:x1875971235924608:12345-192.168.204.23@tcp:101:chown.0 Request processed in 983us (1190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065852.830079:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1789065852.834035:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065852.834292:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235924736 00000100:00100000:0.0:1789065852.834939:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235924736 00000100:00100000:0.0:1789065852.835137:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:0.0:1789065852.835149:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:9691:x1875971235924736:12345-192.168.204.23@tcp:101:chown.0 00010000:00010000:0.0:1789065852.835188:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065852.835212:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8272a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc26 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835292:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835308:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835319:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835333:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835339:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835345:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835465:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8273f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835474:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8273f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835481:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8273f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065852.835510:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789065852.835520:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065852.835579:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8273f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835591:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835606:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835612:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835618:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065852.835623:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835632:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835644:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f200) 00010000:00010000:0.0:1789065852.835647:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065852.835653:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835668:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff000/0x7555615576c82731 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835683:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835690:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.835706:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.840904:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065852.840919:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.840935:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.840953:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf043eb1e00) 00010000:00010000:0.0:1789065852.840957:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065852.840962:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.840968:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82738 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.841039:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8272a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc26 expref: 10 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.841056:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8273f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc26 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.841063:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:0.0:1789065852.841065:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789065852.841068:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ffc00, rc 0) 00000100:00100000:0.0:1789065852.841150:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:9691:x1875971235924736:12345-192.168.204.23@tcp:101:chown.0 Request processed in 6003us (7125us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065852.841179:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1789065852.852118:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065852.852420:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235924992 00000100:00100000:0.0:1789065852.852431:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235924992 00000100:00100000:0.0:1789065852.852491:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:0.0:1789065852.852502:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:9691:x1875971235924992:12345-192.168.204.23@tcp:36:chown.0 00010000:00010000:0.0:1789065852.852577:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065852.852616:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8273f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc26 expref: 9 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.852637:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:0.0:1789065852.852647:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065852.852683:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.852696:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.852707:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065852.911309:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1789065852.976927:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000003bdb4b47 reply state 000000002af7a153 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065852.976947:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789065852.976963:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789065852.977076:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+10:9691:x1875971235924992:12345-192.168.204.23@tcp:36:chown.0 Request processed in 124572us (124965us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789065852.977086:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000001:00080000:2.0:1789065852.978056:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1789065852.978095:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.978107:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.978114:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.978121:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065852.978126:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.978134:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.978150:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065852.978153:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789065852.978158:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065852.978165:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82746 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065853.023958:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065853.024223:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235925120 00000100:00100000:2.0:1789065853.024240:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235925120 00000100:00100000:2.0:1789065853.024305:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1789065853.024317:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:9692:x1875971235925120:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:2.0:1789065853.024344:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065853.024379:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8274d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc2d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789065853.030181:0:5839:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5743us 00010000:00010000:1.0:1789065853.057848:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.057887:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.057900:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.057921:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.057929:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.057939:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.058852:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072400/0x7555615576c82762 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.058866:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072400/0x7555615576c82762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.058874:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072400/0x7555615576c82762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065853.058899:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789065853.058902:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065853.058940:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072400/0x7555615576c82762 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.058952:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059037:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059045:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059051:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065853.059055:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059063:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059077:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f200) 00010000:00010000:1.0:1789065853.059079:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065853.059084:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059089:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82754 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059103:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059107:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059112:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059117:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065853.059126:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059132:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059139:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf06a8c0300) 00010000:00010000:1.0:1789065853.059141:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065853.059144:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059149:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c8275b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059187:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8274d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc2d expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059203:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072400/0x7555615576c82762 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc2d expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.059211:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:1.0:1789065853.059213:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789065853.059216:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072400, rc 0) 00000100:00100000:1.0:1789065853.059577:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9692:x1875971235925120:12345-192.168.204.23@tcp:101:touch.500 Request processed in 35259us (35627us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065853.059588:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1789065853.067813:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065853.068831:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235925376 00000100:00100000:3.0:1789065853.068845:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235925376 00000100:00100000:3.0:1789065853.068900:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:3.0:1789065853.068909:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9692:x1875971235925376:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:3.0:1789065853.068929:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065853.068951:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031a00/0x7555615576c82769 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc34 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.069242:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.069435:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.069454:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.069543:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.070398:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.070412:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789065853.071906:0:5840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:2.0:1789065853.072317:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8277e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072332:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8277e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072342:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8277e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072392:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072400:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072408:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072415:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065853.072419:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072438:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072450:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:2.0:1789065853.072453:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065853.072458:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072475:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82770 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065853.072488:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000009859628e reply state 00000000904d70ea transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065853.072497:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789065853.072530:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031a00/0x7555615576c82769 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc34 expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072543:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8277e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc34 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.072569:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf042e0f700) 00010000:00010000:2.0:1789065853.072572:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065853.072575:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c200, rc 0) 00000100:00100000:2.0:1789065853.073891:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+10:9692:x1875971235925376:12345-192.168.204.23@tcp:101:touch.500 Request processed in 4971us (6075us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789065853.073904:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00010000:00010000:1.0:1789065853.079509:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.079531:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.079582:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.079896:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065853.079903:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.079912:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.079931:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9cf043e52c00) 00010000:00010000:1.0:1789065853.079934:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065853.079939:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.079946:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82777 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065853.084525:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.084631:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235925632 00000100:00100000:0.0:1789065853.084642:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235925632 00000100:00100000:0.0:1789065853.084701:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1789065853.084863:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:9692:x1875971235925632:12345-192.168.204.23@tcp:36:touch.500 00010000:00010000:0.0:1789065853.084924:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065853.084952:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8277e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc34 expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.084971:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf042e0f700) 00010000:00010000:0.0:1789065853.084982:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065853.085024:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.085037:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.085047:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065853.085176:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000845b4b69 reply state 000000007aa295d7 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065853.085186:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065853.085282:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+10:9692:x1875971235925632:12345-192.168.204.23@tcp:36:touch.500 Request processed in 426us (766us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789065853.085290:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00010000:00010000:3.0:1789065853.092119:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.092140:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.092160:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.092166:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065853.092172:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.092180:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.092208:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf043eb1e00) 00010000:00010000:3.0:1789065853.092212:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065853.092217:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.092223:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c8278c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065853.092292:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.092513:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235925760 00000100:00100000:0.0:1789065853.092523:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235925760 00000100:00100000:0.0:1789065853.092686:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:0.0:1789065853.092698:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:9692:x1875971235925760:12345-192.168.204.23@tcp:101:touch.500 00010000:00010000:0.0:1789065853.092839:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065853.092859:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc3b expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.092920:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82793 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc3b expref: 10 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.092934:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82793 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc3b expref: 10 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.092953:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:0.0:1789065853.092956:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789065853.092959:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fe800, rc 0) 00000100:00100000:0.0:1789065853.093285:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+10:9692:x1875971235925760:12345-192.168.204.23@tcp:101:touch.500 Request processed in 588us (995us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065853.093292:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:3.0:1789065853.098765:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.099465:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235925888 00000100:00100000:0.0:1789065853.099478:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235925888 00000100:00100000:0.0:1789065853.099581:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:0.0:1789065853.099599:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875971235925888:12345-192.168.204.23@tcp:8:touch.500 00010000:00080000:0.0:1789065853.099630:0:6688:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp t0 exp 0000000000000000 cur 312 last 0 00000020:00000080:0.0:1789065853.099668:0:6688:0:(genops.c:1384:class_connect()) connect: client 241917dc-ba0e-425a-830a-a04cd9f8b120, cookie 0x7555615576c8279a 00002000:00100000:0.0:1789065853.099680:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 241917dc-ba0e-425a-830a-a04cd9f8b120/ffff9cf06a932800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789065853.099704:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789065853.100053:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789065853.100084:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9cf06a930000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789065853.100176:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2346:x1875971235925888:12345-192.168.204.23@tcp:8:touch.500 Request processed in 586us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065853.100184:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1789065853.104136:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065853.104222:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235926016 00000100:00100000:3.0:1789065853.104233:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235926016 00000100:00100000:3.0:1789065853.104308:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1789065853.104331:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:0:x1875971235926016:12345-192.168.204.23@tcp:2:touch.500 00000100:00080000:2.0:1789065853.104513:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065853.158362:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:0:x1875971235926016:12345-192.168.204.23@tcp:2:touch.500 Request processed in 54025us (54217us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789065853.158377:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000001:00100000:1.0:1789065853.159190:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000001:00080000:1.0:1789065853.159213:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:2.0:1789065853.171910:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065853.172501:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235926272 00000100:00100000:1.0:1789065853.172512:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235926272 00000100:00100000:1.0:1789065853.172787:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1789065853.172800:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+10:9692:x1875971235926272:12345-192.168.204.23@tcp:35:touch.500 00000100:00100000:1.0:1789065853.173194:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+11:9692:x1875971235926272:12345-192.168.204.23@tcp:35:touch.500 Request processed in 396us (1294us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1789065853.173203:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1789065853.208122:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065853.208962:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235926400 00000100:00100000:1.0:1789065853.208987:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235926400 00000100:00100000:1.0:1789065853.209082:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1789065853.209109:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+11:9693:x1875971235926400:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:1.0:1789065853.209138:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065853.209161:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c827a1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc42 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.209247:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c827a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.209271:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c827a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.209283:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c827a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065853.209956:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789065853.209962:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065853.210007:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c827a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.210065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072600/0x7555615576c827a1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc42 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.210100:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c827a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc42 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065853.210109:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:1.0:1789065853.210111:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789065853.210116:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072c00, rc 0) 00000100:00100000:1.0:1789065853.210213:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+12:9693:x1875971235926400:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1106us (2127us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065853.210221:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1789065853.221878:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065853.226412:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235926656 00000100:00100000:2.0:1789065853.226428:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235926656 00000100:00100000:2.0:1789065853.226572:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:2.0:1789065853.226584:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+12:9693:x1875971235926656:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:2.0:1789065853.226616:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065853.226638:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c827af lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc49 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065853.227854:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789065853.228041:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c827af lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc49 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.228056:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f200) 00010000:00010000:2.0:1789065853.228059:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065853.228064:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c827af lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc49 expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.228080:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ce00, rc 0) 00000100:00100000:2.0:1789065853.228158:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+13:9693:x1875971235926656:12345-192.168.204.23@tcp:101:rm.0 Request processed in 1577us (6290us total) trans 4294967303 rc 301/301 00000100:00100000:2.0:1789065853.228167:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:3.0:1789065853.243604:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065853.243855:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235926784 00000100:00100000:1.0:1789065853.243865:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235926784 00000100:00100000:1.0:1789065853.243926:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:1.0:1789065853.243937:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+13:9693:x1875971235926784:12345-192.168.204.23@tcp:37:rm.0 00000100:00100000:1.0:1789065853.250236:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+13:9693:x1875971235926784:12345-192.168.204.23@tcp:37:rm.0 Request processed in 6289us (6685us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065853.250249:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:0.0:1789065853.259144:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065853.259771:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235927040 00000100:00100000:2.0:1789065853.259784:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235927040 00000100:00100000:2.0:1789065853.259896:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1789065853.259908:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+13:9693:x1875971235927040:12345-192.168.204.23@tcp:35:rm.0 00000100:00100000:2.0:1789065853.260243:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba4c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:9693:x1875971235927040:12345-192.168.204.23@tcp:35:rm.0 Request processed in 335us (1106us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789065853.260251:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1789065853.265060:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065853.265145:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235927296 00000100:00100000:3.0:1789065853.265156:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235927296 00000100:00100000:3.0:1789065853.265219:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1789065853.265229:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+14:9693:x1875971235927296:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:3.0:1789065853.265424:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065853.265449:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c827bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc50 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.265656:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c827c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.265672:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c827c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.265684:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c827c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065853.265696:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789065853.265999:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c827bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc50 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.266018:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c827c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc50 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.266027:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:3.0:1789065853.266031:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789065853.266036:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031600, rc 0) 00000100:00100000:3.0:1789065853.266114:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235927296:12345-192.168.204.23@tcp:101:rm.0 Request processed in 884us (1064us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789065853.266122:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1789065853.269728:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.269796:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235927424 00000100:00100000:0.0:1789065853.269807:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235927424 00000100:00100000:0.0:1789065853.270265:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:0.0:1789065853.270277:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235927424:12345-192.168.204.23@tcp:41:rm.0 00000004:00000024:0.0:1789065853.270358:0:8255:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:0.0:1789065853.270453:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae66d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235927424:12345-192.168.204.23@tcp:41:rm.0 Request processed in 177us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065853.270460:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1789065853.287829:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.287991:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235927552 00000100:00100000:0.0:1789065853.288001:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235927552 00000100:00100000:0.0:1789065853.288066:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1789065853.288077:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235927552:12345-192.168.204.23@tcp:101:rm.0 00010000:00010000:0.0:1789065853.288097:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065853.288119:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827d2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc57 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288184:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288221:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288234:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288250:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288818:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288826:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288933:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288942:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.288949:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065853.288978:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789065853.288982:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065853.289000:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289011:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289031:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289038:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289045:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289051:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.289055:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289062:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289074:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:0.0:1789065853.289077:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065853.289081:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289088:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827d9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289100:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289107:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289113:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289126:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.289130:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289136:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289143:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065853.289145:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065853.289148:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289153:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289186:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc57 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289201:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc57 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.289207:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:0.0:1789065853.289210:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789065853.289212:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fec00, rc 0) 00000100:00100000:0.0:1789065853.290581:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:9693:x1875971235927552:12345-192.168.204.23@tcp:101:rm.0 Request processed in 2496us (2926us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065853.290603:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:3.0:1789065853.302198:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.302635:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235927808 00000100:00100000:0.0:1789065853.302669:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235927808 00000100:00100000:0.0:1789065853.302864:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:0.0:1789065853.302876:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+17:9693:x1875971235927808:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1789065853.302932:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789065853.302961:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c827e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc57 expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.302985:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc3b expref: 16 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.302997:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf043eb1600) 00010000:00010000:0.0:1789065853.303012:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c827a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc42 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303023:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:0.0:1789065853.303026:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065853.303047:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303062:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303072:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303087:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303095:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303114:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303248:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303255:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.303262:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789065853.306296:0:8255:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1789065853.306670:0:8255:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 312500120671ns, next at 313499760248ns, rc = 0 00010000:00010000:0.0:1789065853.306869:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.306887:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.306899:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.306908:0:8255:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.306914:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.306920:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307021:0:8255:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789065853.307044:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307050:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307056:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307062:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.307067:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307076:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307088:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf043eb1b00) 00010000:00010000:0.0:1789065853.307090:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789065853.307095:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307100:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c827fc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307120:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307126:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307132:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307144:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.307147:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307152:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307160:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:0.0:1789065853.307162:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065853.307165:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.307171:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c827ee lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065853.307181:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000009a2a7314 reply state 00000000deaee97a transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065853.307191:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065853.307304:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235927808:12345-192.168.204.23@tcp:36:rm.0 Request processed in 4427us (5111us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789065853.307321:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00010000:00010000:0.0:1789065853.314376:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.314394:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.314417:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.314474:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.314481:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.314500:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.314528:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x596de974 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065853.314532:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065853.314538:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.314545:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c827f5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x596de974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.316140:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065853.316154:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.316165:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffa00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065853.316169:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.316178:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.316194:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9cf043eb1b00) 00010000:00010000:2.0:1789065853.316198:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789065853.316202:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.316208:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffa00/0x7555615576c82803 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065853.316230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065853.316232:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065853.316234:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065853.324840:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065853.330481:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928064 00000100:00100000:1.0:1789065853.330498:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928064 00000100:00100000:1.0:1789065853.330641:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1789065853.330664:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+15:9693:x1875971235928064:12345-192.168.204.23@tcp:35:rm.0 00000100:00100000:1.0:1789065853.331172:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235928064:12345-192.168.204.23@tcp:35:rm.0 Request processed in 519us (6339us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789065853.331180:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1789065853.344136:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065853.344466:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928320 00000100:00100000:0.0:1789065853.344477:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928320 00000100:00100000:0.0:1789065853.344544:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:0.0:1789065853.344595:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:9693:x1875971235928320:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1789065853.344661:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789065853.344692:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c827c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc50 expref: 16 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344727:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072400/0x7555615576c82762 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc2d expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344740:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf06a8c0a00) 00010000:00010000:0.0:1789065853.344774:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c82723 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc1f expref: 14 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344784:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f200) 00010000:00010000:0.0:1789065853.344792:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065853.344814:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344826:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344835:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344847:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344853:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.344859:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345117:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345126:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345133:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065853.345745:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789065853.345768:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345776:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345783:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345789:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.345795:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345803:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345813:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9cf043eb1100) 00010000:00010000:0.0:1789065853.345816:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789065853.345819:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345825:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82818 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345844:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345850:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345855:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345860:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065853.345868:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345873:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345881:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065853.345883:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065853.345886:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.345891:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8280a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065853.345903:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000000139c80e reply state 00000000917986bb transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065853.345911:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065853.345988:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058217480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+15:9693:x1875971235928320:12345-192.168.204.23@tcp:36:rm.0 Request processed in 1395us (1860us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1789065853.345996:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00010000:00010000:3.0:1789065853.352701:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.352733:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.352743:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.352752:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065853.352759:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.352767:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.352790:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9cf043eb1600) 00010000:00010000:3.0:1789065853.352794:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065853.352799:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065853.352807:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82811 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065853.926168:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065854.122076:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789065854.122101:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257983104:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065854.122174:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065854.122316:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983104 00000100:00100000:0.0:1789065854.122325:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983104 00000100:00100000:0.0:1789065854.122405:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789065854.122416:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257983104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065854.122439:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065854.122492:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257983104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065854.122498:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1789065854.122871:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789065854.123082:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058215180 x1875971257983104/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065870 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065854.123105:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058215180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257983104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065854.951710:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065855.142511:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257983616:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.142631:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065855.142686:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789065855.142693:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257983232:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.142736:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065855.142759:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257983744:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.142795:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065855.142821:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257983360:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.142858:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065855.142880:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257983872:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.142900:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065855.142918:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065855.142923:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257983488:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.142943:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065855.142992:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983616 00000100:00100000:2.0:1789065855.142999:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983616 00000100:00100000:2.0:1789065855.143042:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983872 00000100:00100000:2.0:1789065855.143044:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983872 00000100:00100000:2.0:1789065855.143074:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789065855.143083:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257983616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143134:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257983616:12345-0@lo:400:kworker.0 Request processed in 52us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.143141:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789065855.143157:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789065855.143164:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257983872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143192:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257983872:12345-0@lo:400:kworker.0 Request processed in 30us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.143198:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789065855.143213:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983232 00000100:00100000:2.0:1789065855.143216:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983232 00000100:00100000:2.0:1789065855.143248:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789065855.143255:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257983232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143300:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257983232:12345-0@lo:400:kworker.0 Request processed in 46us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.143307:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1789065855.143344:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983744 00000100:00100000:2.0:1789065855.143348:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983744 00000100:00100000:2.0:1789065855.143373:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983360 00000100:00100000:2.0:1789065855.143376:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983360 00000100:00100000:2.0:1789065855.143387:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257983488 00000100:00100000:2.0:1789065855.143389:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257983488 00000100:00100000:2.0:1789065855.143403:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789065855.143409:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257983744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143438:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257983744:12345-0@lo:400:kworker.0 Request processed in 29us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.143444:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1789065855.143454:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789065855.143459:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257983360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143485:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257983360:12345-0@lo:400:kworker.0 Request processed in 26us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.143490:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1789065855.143501:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789065855.143507:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257983488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143531:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971257983488:12345-0@lo:400:kworker.0 Request processed in 26us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.143537:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:2.0:1789065855.143588:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789065855.143598:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789065855.143634:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971257983488:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143643:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257983360:0@lo:400:kworker.0 00010000:00080000:2.0:1789065855.143654:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf073e63800 x1875971257983872/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065855.143664:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257983872:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143695:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257983232:0@lo:400:kworker.0 00000100:00100000:2.0:1789065855.143703:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257983744:0@lo:400:kworker.0 00010000:00080000:2.0:1789065855.143713:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf058003100 x1875971257983616/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065855.143722:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058003100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257983616:0@lo:400:kworker.0 00000100:00100000:0.0:1789065855.153245:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257984000:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065855.153333:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065855.153578:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257984000 00000100:00100000:1.0:1789065855.153599:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257984000 00000100:00100000:1.0:1789065855.153650:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789065855.153658:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257984000:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065855.153746:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065855.153800:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257984000:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (466us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065855.153808:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789065855.153849:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07ec8a300 x1875971257984000/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065855.153868:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257984000:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065855.396747:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065855.397649:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065855.397690:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065855.397721:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065855.397834:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928448 00000100:00100000:1.0:1789065855.397845:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928448 00000100:00100000:1.0:1789065855.397899:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 260 00000100:00100000:1.0:1789065855.397910:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235928448:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065855.397983:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235928448:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 74us (1245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065855.397987:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928704 00000100:00100000:1.0:1789065855.397990:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 260 00000100:00100000:0.0:1789065855.397991:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928704 00000100:00100000:0.0:1789065855.398027:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:0.0:1789065855.398034:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2347:x1875971235928704:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065855.398063:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2347:x1875971235928704:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 30us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065855.398068:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:2.0:1789065855.398375:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928576 00000100:00100000:2.0:1789065855.398381:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928576 00000100:00100000:2.0:1789065855.398424:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928832 00000100:00100000:2.0:1789065855.398427:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928832 00000100:00100000:2.0:1789065855.398453:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:2.0:1789065855.398460:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971235928576:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065855.398508:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971235928576:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.398514:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:2.0:1789065855.398528:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:2.0:1789065855.398533:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235928832:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065855.398584:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a748000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235928832:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 50us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065855.398605:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00080000:2.0:1789065855.398626:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789065855.398630:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789065855.974636:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065856.997880:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065858.021750:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789065858.244532:0:11612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:3.0:1789065858.330116:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1789065858.330136:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:3.0:1789065858.330378:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789065858.330403:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257984128:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789065858.330470:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065858.330581:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257984128 00000100:00100000:2.0:1789065858.330590:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257984128 00000100:00080000:3.0:1789065858.330645:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065858.330661:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789065858.330672:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257984128:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789065858.330700:0:6880:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:2.0:1789065858.330732:0:6880:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa2fa7c, atime: 0x6aa2fa7c, ctime: 0x6aa2fa7c, blocks: 0x1 00010000:00010000:2.0:1789065858.330741:0:6880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065858.330757:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=317s v=(0 0) 00010000:00010000:2.0:1789065858.330761:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065858.330767:0:6880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065858.330785:0:6880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065858.330796:0:6880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065858.330803:0:6880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065858.330838:0:6880:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789065858.331375:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971257984128:12345-0@lo:6:osp-syn-0-0.0 Request processed in 704us (903us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789065858.331385:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000004:00080000:2.0:1789065858.331430:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf050e72680/2, rc 0, transno 4294967300 00000100:00100000:2.0:1789065858.331436:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257984128:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1789065858.331745:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065858.331753:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065858.331762:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065858.331766:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065858.331776:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065858.331797:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065858.331804:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8281f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065858.331824:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065858.331826:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065858.331828:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065859.057635:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065859.237841:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257984256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065859.237919:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065859.238028:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257984256 00000100:00100000:3.0:1789065859.238036:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257984256 00000100:00100000:3.0:1789065859.238108:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789065859.238118:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971257984256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065859.238153:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065859.238213:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971257984256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065859.238221:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789065859.238283:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257984256:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065860.072166:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789065860.154988:0:11662:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff766e0e30 20000000:00000080:1.0:1789065860.155010:0:11662:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf0508ff000 uarg=0000000000000000 20000000:01000000:1.0:1789065860.155045:0:11662:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789065860.155052:0:11662:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1789065860.155057:0:11662:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1789065860.156404:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1789065860.156734:0:11662:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1789065860.162934:0:11662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1789065860.162992:0:11662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1789065860.163097:0:11662:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1789065860.163115:0:11662:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789065860.163136:0:11662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163157:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163166:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163174:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c826cf expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163193:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c826dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163200:0:11662:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c826eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163230:0:11662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163280:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c826eb expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163307:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c826eb expref: 18 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.163324:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984384:0@lo:104: 00000100:00100000:2.0:1789065860.163392:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789065860.163469:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c826dd expref: 18 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163479:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c826dd expref: 18 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.163487:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984512:0@lo:104: 00000100:00100000:2.0:1789065860.163508:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789065860.163539:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c826cf expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163579:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c826cf expref: 18 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.163588:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984640:0@lo:104: 00000100:00100000:2.0:1789065860.163612:0:11662:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789065860.163635:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163655:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 12 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.163666:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984768:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065860.163725:0:11662:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.163733:0:11662:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.163741:0:11662:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e73100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984896:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065860.163761:0:11662:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789065860.163925:0:5821:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789065860.163939:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257984384 00000100:00100000:0.0:1789065860.163946:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257984384 00000100:00100000:0.0:1789065860.163983:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257984512 00000100:00100000:0.0:1789065860.163986:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257984512 00000100:00100000:0.0:1789065860.163997:0:5821:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257984640 00000100:00100000:0.0:1789065860.163999:0:5821:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257984640 00000100:00100000:0.0:1789065860.164012:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789065860.164020:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:11662:x1875971257984384:12345-0@lo:104: 00010000:00010000:0.0:1789065860.164033:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164089:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065860.164096:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+5:11662:x1875971257984384:12345-0@lo:104: Request processed in 77us (703us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065860.164110:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789065860.164128:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065860.164134:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:11662:x1875971257984512:12345-0@lo:104: 00010000:00010000:0.0:1789065860.164141:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164174:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789065860.164179:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e72d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+4:11662:x1875971257984512:12345-0@lo:104: Request processed in 46us (671us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065860.164185:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065860.164197:0:5821:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065860.164203:0:5821:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ac67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:11662:x1875971257984640:12345-0@lo:104: 00010000:00010000:0.0:1789065860.164210:0:5821:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164258:0:5821:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789065860.164263:0:5821:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ac67050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+3:11662:x1875971257984640:12345-0@lo:104: Request processed in 61us (651us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065860.164269:0:5821:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1789065860.164303:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789065860.164308:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164316:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073800 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065860.164319:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164337:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065860.164344:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065860.164349:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065860.164378:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164384:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065860.164403:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164410:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf06b073800/0x7555615576c826eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826f2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164424:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789065860.164427:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164432:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065860.164434:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164441:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065860.164446:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065860.164469:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065860.164483:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164489:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065860.164496:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164502:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf06b073a00/0x7555615576c826dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826e4 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164511:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065860.164513:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164518:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072800 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065860.164521:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164527:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065860.164533:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065860.164538:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789065860.164576:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164582:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065860.164604:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164611:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf06b072800/0x7555615576c826cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c826d6 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164625:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065860.164627:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065860.164629:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065860.164636:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065860.164643:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065860.164662:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257985024:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065860.164692:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065860.164721:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065860.164727:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257985152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065860.164751:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065860.164776:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257985280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065860.164795:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065860.164824:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985024 00000100:00100000:0.0:1789065860.164828:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985024 00010000:00010000:0.0:1789065860.164848:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c826eb expref: 19 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065860.164866:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985152 00000100:00100000:0.0:1789065860.164869:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985152 00010000:00010000:0.0:1789065860.164879:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c826dd expref: 20 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065860.164889:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985280 00000100:00100000:0.0:1789065860.164891:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985280 00010000:00010000:0.0:1789065860.164909:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c826cf expref: 21 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065860.164923:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065860.164929:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+21:3297:x1875971257985024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065860.164939:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065860.164945:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c826eb expref: 21 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164956:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c826eb expref: 21 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.164970:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065860.164997:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+21:3297:x1875971257985024:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065860.165003:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789065860.165016:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789065860.165022:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+20:3297:x1875971257985152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065860.165030:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065860.165034:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c826dd expref: 20 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.165042:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c826dd expref: 20 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.165052:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065860.165073:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+20:3297:x1875971257985152:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065860.165080:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789065860.165098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789065860.165103:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257985280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065860.165111:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065860.165116:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c826cf expref: 19 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.165125:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c826cf expref: 19 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065860.165134:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065860.165162:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e0ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971257985280:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065860.165168:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789065860.165247:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971257985280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065860.165273:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257985152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065860.165281:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257985024:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789065860.165597:0:11662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030c00/0x7555615576c826f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c826eb expref: 18 pid: 5832 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.165611:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984384:0@lo:104: 00010000:00010000:2.0:1789065860.165622:0:11662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041682400/0x7555615576c826e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c826dd expref: 17 pid: 5831 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.165630:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984512:0@lo:104: 00010000:00010000:2.0:1789065860.165639:0:11662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c826d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c826cf expref: 16 pid: 5833 timeout: 469 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.165645:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984640:0@lo:104: 00000100:00100000:2.0:1789065860.169041:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e73480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984768:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065860.169055:0:11662:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e73100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11662:1875971257984896:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065860.169103:0:11662:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.171036:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065860.171071:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065860.171131:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235928960 00000100:00100000:1.0:1789065860.171153:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235928960 00010000:00010000:1.0:1789065860.171192:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 13 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065860.171238:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929088 00000100:00100000:1.0:1789065860.171241:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929088 00010000:00010000:1.0:1789065860.171263:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 14 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065860.171298:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1789065860.171307:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+14:2347:x1875971235928960:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065860.171323:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065860.171328:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 14 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171341:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 14 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171359:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821fea00/0x7555615576c826c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc11 expref: 14 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171374:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065860.171424:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235928960:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 118us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065860.171431:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1789065860.171447:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:1.0:1789065860.171453:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:2347:x1875971235929088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065860.171472:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065860.171477:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171493:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171504:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821fee00/0x7555615576c826c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc0a expref: 12 pid: 5833 timeout: 419 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171515:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171524:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171539:0:8446:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171620:0:8446:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171629:0:8446:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171635:0:8446:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171642:0:8446:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1ce00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065860.171646:0:8446:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171655:0:8446:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171678:0:8446:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065860.171687:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065860.171708:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e73480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:2347:x1875971235929088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 255us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065860.171715:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:2.0:1789065860.172116:0:11662:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.172127:0:11662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065860.172133:0:11662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c82826 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065860.263645:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065860.263670:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257985408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065860.263743:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065860.264059:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985408 00000100:00100000:3.0:1789065860.264067:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985408 00000100:00100000:3.0:1789065860.264120:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789065860.264130:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257985408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789065860.264178:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065860.264233:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257985408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.264240:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789065860.264311:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257985664:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264355:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065860.264380:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065860.264385:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07a749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257985536:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264409:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789065860.264433:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065860.264450:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985664 00000100:00100000:3.0:1789065860.264453:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985664 00000100:00100000:3.0:1789065860.264484:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985536 00000100:00100000:3.0:1789065860.264487:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985536 00000100:00100000:3.0:1789065860.264503:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789065860.264508:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257985664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264542:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257985664:12345-0@lo:400:kworker.0 Request processed in 33us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.264569:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1789065860.264589:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1789065860.264595:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257985536:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264627:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257985536:12345-0@lo:400:kworker.0 Request processed in 33us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.264633:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00080000:3.0:1789065860.264653:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065860.264685:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a749880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257985536:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264696:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07a74bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257985664:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264719:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257985792:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264743:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789065860.264779:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf050e72300 x1875971257985408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065876 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065860.264794:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257985408:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065860.264805:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065860.264809:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257985920:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264830:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065860.264907:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985792 00000100:00100000:3.0:1789065860.264911:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985792 00000100:00100000:3.0:1789065860.264946:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789065860.264952:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257985792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.264984:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257985792:12345-0@lo:400:kworker.0 Request processed in 32us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.264989:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:3.0:1789065860.265004:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065860.265010:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257985920 00000100:00100000:3.0:1789065860.265020:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257985920 00000100:00100000:3.0:1789065860.265042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1789065860.265046:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257985920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.265072:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971257985920:12345-0@lo:400:kworker.0 Request processed in 25us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.265077:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1789065860.265089:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065860.265103:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971257985920:0@lo:400:kworker.0 00000100:00100000:3.0:1789065860.265111:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081768700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257985792:0@lo:400:kworker.0 00000100:00100000:0.0:1789065860.525158:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065860.525246:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065860.525349:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929216 00000100:00100000:3.0:1789065860.525368:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929216 00000100:00100000:2.0:1789065860.525436:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929344 00000100:00100000:2.0:1789065860.525448:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929344 00000100:00100000:2.0:1789065860.525598:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:2.0:1789065860.525611:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235929344:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065860.525698:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235929344:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 91us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065860.525706:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:3.0:1789065860.526198:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:3.0:1789065860.526218:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235929216:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065860.526358:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235929216:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 63us (1022us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.526367:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00080000:1.0:1789065860.526388:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789065860.526394:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065860.536179:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065860.536318:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929472 00000100:00100000:3.0:1789065860.536328:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929472 00000100:00100000:3.0:1789065860.536417:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00100000:3.0:1789065860.536427:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235929472:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065860.536506:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235929472:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 80us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065860.536522:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00080000:1.0:1789065860.536659:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789065861.094608:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789065861.544262:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789065861.544273:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf081779000 from 7 10000000:01000000:2.0:1789065861.544279:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789065861.544350:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.544388:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.544403:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065861.544437:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986048:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.544532:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065861.544695:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789065861.545115:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986048 00000100:00100000:0.0:1789065861.545126:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986048 00000100:00100000:0.0:1789065861.545215:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1789065861.545227:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:5835:x1875971257986048:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789065861.545245:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065861.545268:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0821ff000/0x7555615576c82834 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8282d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065861.545313:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0821ff000/0x7555615576c82834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8282d expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065861.545326:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0821ff000/0x7555615576c82834 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8282d expref: 17 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065861.545337:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ff000, rc 0) 00000100:00100000:0.0:1789065861.545406:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257986048:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 181us (874us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065861.545414:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1789065861.545600:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986048:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065861.545620:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.545642:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065861.545727:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.546159:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065861.546219:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd840 going to sleep for 11 seconds 00000100:00100000:3.0:1789065861.546301:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986176 00000100:00100000:3.0:1789065861.546308:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986176 00000100:00100000:3.0:1789065861.546354:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1789065861.546374:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257986176:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065861.547100:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050984850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257986176:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 722us (1329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065861.547111:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:2.0:1789065861.547249:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986176:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.547303:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.547358:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065861.547397:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1789065861.547466:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986304 00000100:00100000:1.0:1789065861.547473:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986304 00000100:00100000:1.0:1789065861.547521:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789065861.547530:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257986304:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789065861.547805:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257986304:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 276us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065861.547812:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1789065861.548066:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986304:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065861.548981:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11675:1875971257986432:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065861.549049:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065861.549091:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce30c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065861.549148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986432 00000100:00100000:1.0:1789065861.549155:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986432 00000100:00100000:1.0:1789065861.549207:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1789065861.549216:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:11675:x1875971257986432:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065861.549427:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:11675:x1875971257986432:12345-0@lo:502:llog_process_th.0 Request processed in 210us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065861.549435:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789065861.549597:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11675:1875971257986432:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789065861.550010:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789065861.550024:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065861.550027:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789065861.550036:0:11675:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf081779000 00000020:00000080:3.0:1789065861.550038:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789065861.550223:0:11675:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11675:1875971257986560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065861.550278:0:11675:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065861.550322:0:11675:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065861.553091:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986560 00000100:00100000:0.0:1789065861.553116:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986560 00000100:00100000:0.0:1789065861.553216:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1789065861.553228:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:11675:x1875971257986560:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065861.553634:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050987050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:11675:x1875971257986560:12345-0@lo:502:llog_process_th.0 Request processed in 407us (3354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065861.553645:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1789065861.556961:0:11675:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11675:1875971257986560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789065861.557033:0:11675:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065861.557049:0:11675:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065861.557052:0:11675:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789065861.557059:0:11675:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789065861.559077:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1789065861.559128:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789065861.559143:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065861.559160:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065861.559174:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789065861.559177:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07a795800 from 7 10000000:01000000:0.0:1789065861.559213:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789065861.559269:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065861.559279:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065861.559291:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065861.559322:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.559429:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065861.559500:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b900 going to sleep for 11 seconds 00000100:00100000:1.0:1789065861.559616:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986688 00000100:00100000:1.0:1789065861.559627:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986688 00000100:00100000:1.0:1789065861.559703:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1789065861.559723:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:5835:x1875971257986688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065861.559742:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065861.559758:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072400/0x7555615576c82842 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8283b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065861.559797:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072400/0x7555615576c82842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8283b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065861.559809:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072400/0x7555615576c82842 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8283b expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065861.559819:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072400, rc 0) 00000100:00100000:1.0:1789065861.559874:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050985050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257986688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 154us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065861.559882:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1789065861.560251:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789065861.560275:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065861.560285:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065861.560378:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065861.560413:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065861.560438:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065861.561100:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986816 00000100:00100000:0.0:1789065861.561112:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986816 00000100:00100000:0.0:1789065861.561162:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1789065861.561171:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257986816:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.561732:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257986816:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 430us (1186us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065861.561743:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1789065861.561956:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986816:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789065861.562010:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789065861.562059:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065861.562087:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093dcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065861.562145:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257986944 00000100:00100000:0.0:1789065861.562151:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257986944 00000100:00100000:0.0:1789065861.562185:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1789065861.562201:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257986944:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.562376:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257986944:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065861.562382:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:3.0:1789065861.562840:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257986944:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.565927:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11676:1875971257987072:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065861.566071:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065861.566122:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b780 going to sleep for 11 seconds 00000100:00100000:1.0:1789065861.566655:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987072 00000100:00100000:1.0:1789065861.566674:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987072 00000100:00100000:1.0:1789065861.566744:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1789065861.566755:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:11676:x1875971257987072:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065861.567065:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050986c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:11676:x1875971257987072:12345-0@lo:502:llog_process_th.0 Request processed in 311us (994us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065861.567074:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1789065861.567973:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11676:1875971257987072:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789065861.568029:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789065861.568042:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065861.568045:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789065861.568053:0:11676:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf07a795800 00000020:00000080:0.0:1789065861.568056:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789065861.568167:0:11676:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11676:1875971257987200:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065861.568250:0:11676:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065861.568292:0:11676:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b780 going to sleep for 11 seconds 00000100:00100000:3.0:1789065861.568923:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987200 00000100:00100000:3.0:1789065861.568935:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987200 00000100:00100000:3.0:1789065861.568995:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1789065861.569006:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:11676:x1875971257987200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065861.569329:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:11676:x1875971257987200:12345-0@lo:502:llog_process_th.0 Request processed in 322us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065861.569340:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1789065861.570062:0:11676:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11676:1875971257987200:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789065861.570118:0:11676:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789065861.570127:0:11676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789065861.570130:0:11676:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789065861.570134:0:11676:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789065861.570638:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1789065861.570663:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789065861.570687:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065861.570702:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065861.570716:0:5835:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789065861.570734:0:5835:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf04c2a4800 from 7 10000000:01000000:3.0:1789065861.570738:0:5835:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789065861.570784:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065861.570794:0:5835:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065861.570805:0:5835:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065861.570833:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257987328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789065861.570904:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065861.570960:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065861.571010:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987328 00000100:00100000:2.0:1789065861.571050:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987328 00000100:00100000:2.0:1789065861.571111:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789065861.571122:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:5835:x1875971257987328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065861.571139:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065861.571169:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1c000/0x7555615576c82850 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c82849 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.571212:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1c000/0x7555615576c82850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c82849 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.571224:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1c000/0x7555615576c82850 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c82849 expref: 19 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.571234:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789065861.571322:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257987328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065861.571330:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1789065861.571424:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257987328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065861.571447:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.571460:0:5835:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065861.571545:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257987456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.571620:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065861.571643:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd540 going to sleep for 11 seconds 00000100:00100000:0.0:1789065861.576340:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987456 00000100:00100000:0.0:1789065861.576373:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987456 00000100:00100000:0.0:1789065861.576463:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789065861.576475:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257987456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.576960:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257987456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 485us (5348us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065861.576969:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:0.0:1789065861.577049:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257987456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.577122:0:5835:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257987584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.577212:0:5835:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065861.577257:0:5835:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065861.580310:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987584 00000100:00100000:2.0:1789065861.580343:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987584 00000100:00100000:2.0:1789065861.587541:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789065861.587592:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257987584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.587985:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:5835:x1875971257987584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 415us (10772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065861.587994:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1789065861.588136:0:5835:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:8c7529dd-e8b4-44e5-b83f-e77028f31a41:5835:1875971257987584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789065861.588511:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11678:1875971257987712:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065861.588600:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065861.588633:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987712 00000100:00100000:2.0:1789065861.588640:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987712 00000100:00100000:2.0:1789065861.588680:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789065861.588688:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:11678:x1875971257987712:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065861.588858:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:11678:x1875971257987712:12345-0@lo:502:llog_process_th.0 Request processed in 171us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065861.588867:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:2.0:1789065861.588914:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789065861.588928:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11678:1875971257987712:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789065861.588953:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789065861.588964:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065861.588967:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789065861.588976:0:11678:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf04c2a4800 00000020:00000080:2.0:1789065861.588978:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789065861.589064:0:11678:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11678:1875971257987840:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065861.589099:0:11678:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065861.589125:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987840 00000100:00100000:2.0:1789065861.589129:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987840 00000100:00100000:2.0:1789065861.589151:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789065861.589156:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:11678:x1875971257987840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065861.589297:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:11678:x1875971257987840:12345-0@lo:502:llog_process_th.0 Request processed in 140us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065861.589304:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789065861.589339:0:11678:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06e1cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1789065861.589352:0:11678:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:8c7529dd-e8b4-44e5-b83f-e77028f31a41:11678:1875971257987840:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789065861.589372:0:11678:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065861.589377:0:11678:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065861.589378:0:11678:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789065861.589383:0:11678:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789065861.589443:0:5835:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789065861.589464:0:5835:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789065861.589476:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.589487:0:5835:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789065861.626146:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789065861.943766:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065861.943996:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929600 00000100:00100000:2.0:1789065861.944007:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929600 00000100:00100000:2.0:1789065861.944068:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 276 00000100:00100000:2.0:1789065861.944080:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:5595:x1875971235929600:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789065861.944099:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065861.944120:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1d000/0x7555615576c82857 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc5e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.944166:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1d000/0x7555615576c82857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc5e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.944178:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1d000/0x7555615576c82857 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc5e expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065861.944199:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d000, rc 0) 00000100:00100000:2.0:1789065861.944268:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235929600:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 189us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065861.944275:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 276 00000100:00100000:0.0:1789065861.949376:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065861.950134:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929728 00000100:00100000:1.0:1789065861.950145:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929728 00000100:00100000:1.0:1789065861.950282:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 277 00000100:00100000:1.0:1789065861.950294:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235929728:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789065861.951287:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235929728:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 991us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065861.951306:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 277 00000100:00100000:1.0:1789065861.969622:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065861.969774:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929856 00000100:00100000:0.0:1789065861.969797:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929856 00000100:00100000:0.0:1789065861.969855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 278 00000100:00100000:0.0:1789065861.969865:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235929856:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065861.971708:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235929856:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 1833us (2085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065861.971722:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 278 00000100:00100000:0.0:1789065861.990718:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065861.991172:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235929984 00000100:00100000:2.0:1789065861.991192:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235929984 00000100:00100000:2.0:1789065861.991247:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 279 00000100:00100000:2.0:1789065861.991259:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:9965:x1875971235929984:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789065861.991533:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:9965:x1875971235929984:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 275us (824us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065861.991542:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 279 00000100:00100000:2.0:1789065862.008217:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065862.008352:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930112 00000100:00100000:0.0:1789065862.008363:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930112 00000100:00100000:0.0:1789065862.008418:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 280 00000100:00100000:0.0:1789065862.008429:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:9965:x1875971235930112:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789065862.008741:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:9965:x1875971235930112:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 312us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065862.008749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 280 00000100:00100000:0.0:1789065862.021376:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065862.022624:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930240 00000100:00100000:1.0:1789065862.022639:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930240 00000100:00100000:1.0:1789065862.022712:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 281 00000100:00100000:1.0:1789065862.022725:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:5595:x1875971235930240:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065862.022741:0:5832:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065862.022762:0:5832:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf06b072600/0x7555615576c8285e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc65 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065862.022995:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf06b072600/0x7555615576c8285e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc65 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065862.023009:0:5832:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf06b072600/0x7555615576c8285e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc65 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065862.023017:0:5832:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072600, rc 0) 00000100:00100000:1.0:1789065862.023090:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235930240:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 367us (1723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065862.023098:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 281 00000100:00100000:1.0:1789065862.026038:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065862.026255:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930368 00000100:00100000:2.0:1789065862.026265:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930368 00000100:00100000:2.0:1789065862.026325:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 282 00000100:00100000:2.0:1789065862.026336:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235930368:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789065862.027710:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235930368:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 1368us (1673us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065862.027724:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 282 00000100:00100000:2.0:1789065862.034436:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065862.045099:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930496 00000100:00100000:0.0:1789065862.045116:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930496 00000100:00100000:0.0:1789065862.045206:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 283 00000100:00100000:0.0:1789065862.045217:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235930496:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789065862.045739:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:5595:x1875971235930496:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 520us (11310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065862.045757:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 283 00000100:00100000:0.0:1789065862.049338:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065862.058090:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930624 00000100:00100000:1.0:1789065862.058106:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930624 00000100:00100000:1.0:1789065862.058533:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 284 00000100:00100000:1.0:1789065862.058545:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:9968:x1875971235930624:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789065862.058866:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:9968:x1875971235930624:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 323us (9536us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065862.058881:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 284 00000100:00100000:2.0:1789065862.067044:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065862.077490:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930752 00000100:00100000:0.0:1789065862.077509:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930752 00000100:00100000:1.0:1789065862.077645:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 285 00000100:00100000:1.0:1789065862.077659:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:9968:x1875971235930752:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789065862.077961:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05083e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:9968:x1875971235930752:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 305us (10926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065862.077970:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 285 00010000:00010000:0.0:1789065862.118356:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789065862.632786:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789065863.143433:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789065863.409871:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1789065864.165988:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065864.360877:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065864.360904:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257987968:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065864.360975:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065864.361231:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257987968 00000100:00100000:1.0:1789065864.361241:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257987968 00000100:00100000:1.0:1789065864.361321:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789065864.361332:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257987968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789065864.361369:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065864.361430:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257987968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065864.361438:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789065864.361505:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:2.0:1789065864.361511:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf050e72680, transno 4294967300 00000100:00100000:2.0:1789065864.361538:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257987968:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789065864.362054:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789065865.189801:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065865.381884:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257988352:0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.381934:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257988480:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.381984:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065865.381996:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065865.382056:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789065865.382056:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1789065865.382066:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257988096:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382068:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257988224:0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.382104:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065865.382128:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065865.382144:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257988608:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382154:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257988736:0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.382175:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065865.382190:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065865.382219:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988480 00000100:00100000:0.0:1789065865.382227:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988480 00000100:00100000:1.0:1789065865.382252:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988096 00000100:00100000:1.0:1789065865.382264:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988096 00000100:00100000:0.0:1789065865.382289:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988736 00000100:00100000:0.0:1789065865.382294:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988736 00000100:00100000:1.0:1789065865.382301:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1789065865.382313:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257988096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.382335:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789065865.382345:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257988480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382371:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257988096:12345-0@lo:400:kworker.0 Request processed in 61us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.382380:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1789065865.382392:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257988480:12345-0@lo:400:kworker.0 Request processed in 48us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065865.382401:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789065865.382420:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789065865.382425:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988352 00000100:00100000:0.0:1789065865.382430:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257988736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382431:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988352 00000100:00100000:1.0:1789065865.382459:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988224 00000100:00100000:1.0:1789065865.382462:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988224 00000100:00100000:1.0:1789065865.382476:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988608 00000100:00100000:1.0:1789065865.382479:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988608 00000100:00100000:0.0:1789065865.382490:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257988736:12345-0@lo:400:kworker.0 Request processed in 62us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.382496:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789065865.382503:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789065865.382507:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257988352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382541:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257988352:12345-0@lo:400:kworker.0 Request processed in 38us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.382575:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1789065865.382589:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257988096:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382590:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1789065865.382602:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257988224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.382609:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd22300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257988480:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382636:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257988224:12345-0@lo:400:kworker.0 Request processed in 35us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.382644:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789065865.382651:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257988224:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382661:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00010000:00080000:0.0:1789065865.382667:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f50ce00 x1875971257988736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065881 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065865.382672:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257988608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.382686:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257988736:0@lo:400:kworker.0 00000100:00100000:0.0:1789065865.382698:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257988352:0@lo:400:kworker.0 00000100:00100000:1.0:1789065865.382717:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257988608:12345-0@lo:400:kworker.0 Request processed in 48us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.382725:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789065865.382732:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257988608:0@lo:400:kworker.0 00000100:00080000:1.0:1789065865.382754:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789065865.382760:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065865.386136:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257988864:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065865.386203:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065865.386282:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988864 00000100:00100000:1.0:1789065865.386291:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988864 00000100:00100000:1.0:1789065865.386340:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789065865.386351:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257988864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789065865.386387:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065865.387586:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257988864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1230us (1375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.387599:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1789065865.387762:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf050e70700 x1875971257988864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065881 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065865.387783:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257988864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065865.645595:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065865.645646:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065865.645699:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931008 00000100:00100000:0.0:1789065865.645710:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931008 00000100:00100000:0.0:1789065865.645785:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931264 00000100:00100000:0.0:1789065865.645788:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931264 00000100:00100000:0.0:1789065865.645812:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00100000:0.0:1789065865.645823:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235931008:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065865.645916:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235931008:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 94us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065865.645923:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00100000:0.0:1789065865.645941:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:0.0:1789065865.645946:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235931264:12345-192.168.204.23@tcp:400:kworker.0 00000100:00080000:1.0:1789065865.646063:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065865.646151:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235931264:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 203us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065865.646158:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:0.0:1789065865.650649:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065865.650696:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065865.650789:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235930880 00000100:00100000:1.0:1789065865.650800:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235930880 00000100:00100000:1.0:1789065865.650858:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 287 00000100:00100000:1.0:1789065865.650868:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235930880:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065865.650946:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235930880:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065865.650954:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 287 00000100:00100000:3.0:1789065865.651756:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931136 00000100:00100000:3.0:1789065865.651766:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931136 00000100:00100000:3.0:1789065865.651832:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:3.0:1789065865.651841:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235931136:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065865.651898:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235931136:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 58us (1200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065865.651904:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00080000:1.0:1789065865.652585:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789065866.214277:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065867.240972:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065868.261787:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065869.287677:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065869.480934:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065869.480972:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257988992:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065869.481064:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065869.483143:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257988992 00000100:00100000:3.0:1789065869.483157:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257988992 00000100:00100000:3.0:1789065869.483256:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789065869.483265:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257988992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065869.483319:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065869.483405:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257988992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065869.483413:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789065869.483468:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257988992:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789065869.483616:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789065870.310749:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065870.505660:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257989120:0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.505737:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065870.505782:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257989632:0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.505809:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065870.505833:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065870.505839:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257989504:0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.505863:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065870.505889:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257989248:0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.505909:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065870.505932:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257989760:0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.505938:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989632 00000100:00100000:2.0:1789065870.505946:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989632 00000100:00100000:3.0:1789065870.505949:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065870.505966:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065870.505972:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257989376:0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.505991:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065870.505996:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989248 00000100:00100000:2.0:1789065870.505999:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989248 00000100:00100000:2.0:1789065870.506011:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989376 00000100:00100000:2.0:1789065870.506013:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989376 00000100:00100000:3.0:1789065870.506015:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989120 00000100:00100000:3.0:1789065870.506032:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989120 00000100:00100000:2.0:1789065870.506044:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789065870.506052:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257989632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.506053:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789065870.506058:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257989120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.506106:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257989632:12345-0@lo:400:kworker.0 Request processed in 53us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065870.506116:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789065870.506134:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789065870.506140:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257989248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.506169:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257989248:12345-0@lo:400:kworker.0 Request processed in 30us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065870.506174:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789065870.506196:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789065870.506201:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257989376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.506226:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257989376:12345-0@lo:400:kworker.0 Request processed in 25us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065870.506232:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1789065870.506248:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989504 00000100:00100000:2.0:1789065870.506251:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989504 00000100:00100000:2.0:1789065870.506273:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989760 00000100:00100000:2.0:1789065870.506276:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989760 00000100:00100000:2.0:1789065870.506297:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789065870.506303:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257989504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.508395:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257989120:12345-0@lo:400:kworker.0 Request processed in 2327us (2650us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065870.508419:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1789065870.508478:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789065870.508488:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257989760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065870.508561:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257989760:12345-0@lo:400:kworker.0 Request processed in 62us (2596us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065870.508567:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789065870.517276:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257989888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065870.517354:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065870.517733:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257989888 00000100:00100000:0.0:1789065870.517741:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257989888 00000100:00100000:0.0:1789065870.517790:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789065870.517799:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257989888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065870.517837:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065870.517890:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257989888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065870.517899:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:0.0:1789065870.517947:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07b1bad80 x1875971257989888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065886 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065870.517981:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257989888:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789065870.518150:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789065870.518155:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065870.525262:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257989504:12345-0@lo:400:kworker.0 Request processed in 18947us (19386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065870.525279:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789065870.525370:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257989376:0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.525384:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257989248:0@lo:400:kworker.0 00010000:00080000:2.0:1789065870.525399:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf0508f8700 x1875971257989760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065886 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065870.525410:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257989760:0@lo:400:kworker.0 00000100:00100000:0.0:1789065870.536761:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257989504:0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.547885:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257989120:0@lo:400:kworker.0 00000100:00100000:2.0:1789065870.547906:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257989632:0@lo:400:kworker.0 00000100:00100000:0.0:1789065870.763864:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065870.763905:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065870.763936:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065870.764006:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065870.764090:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931520 00000100:00100000:2.0:1789065870.764099:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931520 00000100:00100000:2.0:1789065870.764163:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931776 00000100:00100000:2.0:1789065870.764167:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931776 00000100:00100000:2.0:1789065870.764206:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00100000:2.0:1789065870.764216:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235931520:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065870.764298:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235931520:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 83us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065870.764304:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00100000:2.0:1789065870.764323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00100000:2.0:1789065870.764329:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235931776:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065870.764351:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235931776:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 23us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065870.764356:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00080000:0.0:1789065870.764540:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065870.764684:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931392 00000100:00100000:3.0:1789065870.764689:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931392 00000100:00100000:3.0:1789065870.764728:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 289 00000100:00100000:3.0:1789065870.764736:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235931392:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065870.764780:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235931392:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 44us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065870.764786:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 289 00000100:00100000:3.0:1789065870.764817:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931648 00000100:00100000:3.0:1789065870.764820:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931648 00000100:00100000:3.0:1789065870.764852:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:3.0:1789065870.764858:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235931648:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065870.764884:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235931648:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065870.764889:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00080000:3.0:1789065870.764909:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789065871.335286:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065872.358159:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789065872.870283:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789065873.382615:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065874.408208:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065874.599355:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065874.599378:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257990016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065874.599465:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065874.599801:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990016 00000100:00100000:3.0:1789065874.599810:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990016 00000100:00100000:3.0:1789065874.599884:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789065874.599895:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257990016:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789065874.599960:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789065874.599962:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789065874.600030:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257990016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 137us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065874.600037:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789065874.601772:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257990016:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065875.433487:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065875.622187:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257990144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065875.622274:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065875.622645:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990144 00000100:00100000:0.0:1789065875.622653:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990144 00000100:00080000:1.0:1789065875.622761:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065875.623289:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789065875.623300:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257990144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065875.623338:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065875.623401:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257990144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065875.623409:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00010000:00080000:1.0:1789065875.623487:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07b1b8e00 x1875971257990144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065891 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065875.623525:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257990144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065875.624119:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257990656:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624152:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065875.624182:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789065875.624187:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257990528:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624209:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065875.624246:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990528 00000100:00100000:1.0:1789065875.624251:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990528 00000100:00100000:1.0:1789065875.624290:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789065875.624298:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257990528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624336:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971257990528:12345-0@lo:400:kworker.0 Request processed in 39us (126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065875.624343:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1789065875.624361:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065875.624380:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971257990528:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624405:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257990400:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624426:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065875.624443:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789065875.624447:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257990272:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624468:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065875.624486:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257990784:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624502:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065875.624520:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990400 00000100:00100000:1.0:1789065875.624524:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990400 00000100:00100000:1.0:1789065875.624569:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990784 00000100:00100000:1.0:1789065875.624572:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990784 00000100:00100000:1.0:1789065875.624594:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789065875.624599:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257990400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624630:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257990400:12345-0@lo:400:kworker.0 Request processed in 30us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065875.624635:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789065875.624647:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789065875.624652:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257990784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624674:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971257990784:12345-0@lo:400:kworker.0 Request processed in 22us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065875.624680:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1789065875.624693:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990272 00000100:00100000:1.0:1789065875.624696:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990272 00000100:00100000:1.0:1789065875.624714:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:1.0:1789065875.624719:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257990272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624743:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971257990272:12345-0@lo:400:kworker.0 Request processed in 24us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065875.624749:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00080000:1.0:1789065875.624770:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065875.624786:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971257990272:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624795:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971257990784:0@lo:400:kworker.0 00000100:00100000:1.0:1789065875.624802:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257990400:0@lo:400:kworker.0 00000100:00100000:3.0:1789065875.624969:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990656 00000100:00100000:3.0:1789065875.624974:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990656 00000100:00100000:3.0:1789065875.625012:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789065875.625019:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257990656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065875.625052:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257990656:12345-0@lo:400:kworker.0 Request processed in 35us (900us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065875.625058:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789065875.626308:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257990656:0@lo:400:kworker.0 00000100:00100000:3.0:1789065875.875331:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065875.875394:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065875.875499:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235931904 00000100:00100000:2.0:1789065875.875510:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235931904 00000100:00100000:2.0:1789065875.875599:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 291 00000100:00100000:2.0:1789065875.875611:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235931904:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065875.875684:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235931904:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 76us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065875.875691:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 291 00000100:00100000:1.0:1789065875.876059:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932032 00000100:00100000:1.0:1789065875.876080:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932032 00000100:00100000:1.0:1789065875.876141:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00100000:1.0:1789065875.876149:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235932032:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065875.876197:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235932032:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 49us (802us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065875.876203:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00080000:2.0:1789065875.876619:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065875.896939:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065875.897042:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932160 00000100:00100000:0.0:1789065875.897054:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932160 00000100:00100000:0.0:1789065875.897138:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:0.0:1789065875.897151:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2346:x1875971235932160:12345-192.168.204.23@tcp:9:kworker.0 00000020:00000080:0.0:1789065875.897217:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8279a 00000100:00080000:0.0:1789065875.897229:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9cf06a930000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789065875.897282:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:1.0:1789065875.897497:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065875.897610:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+2:2346:x1875971235932160:12345-192.168.204.23@tcp:9:kworker.0 Request processed in 460us (681us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065875.897618:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00080000:2.0:1789065875.897747:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065875.902110:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065875.902219:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932288 00000100:00100000:1.0:1789065875.902228:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932288 00000100:00100000:1.0:1789065875.902309:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00100000:1.0:1789065875.902320:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235932288:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065875.902424:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235932288:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 105us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065875.902432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00080000:2.0:1789065875.902768:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789065876.453796:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065877.478068:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065878.501780:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789065878.804268:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:3.0:1789065878.804277:0:6711:0:(genops.c:885:class_export_put()) final put ffff9cf06a932800/241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:0.0:1789065878.804412:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf06a932800/241917dc-ba0e-425a-830a-a04cd9f8b120 for lustre-OST0000 00000020:00000080:0.0:1789065878.804466:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf06a930000 for lustre-OST0000 00010000:00010000:0.0:1789065879.526076:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065879.719246:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065879.719272:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257990912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065879.719348:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065879.719503:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257990912 00000100:00100000:0.0:1789065879.719513:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257990912 00000100:00100000:0.0:1789065879.719598:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789065879.719608:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257990912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065879.719646:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065879.719695:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257990912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065879.719701:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:2.0:1789065879.720060:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065879.720100:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257990912:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789065880.563481:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065880.743679:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257991040:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.743753:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065880.743817:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257991552:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.743852:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065880.743878:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789065880.743883:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257991168:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.743903:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065880.743919:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257991680:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.743940:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065880.743969:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257991296:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744005:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065880.744024:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065880.744029:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257991424:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744061:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065880.744097:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991040 00000100:00100000:1.0:1789065880.744105:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991040 00000100:00100000:1.0:1789065880.744149:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789065880.744157:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257991040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744205:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257991040:12345-0@lo:400:kworker.0 Request processed in 48us (451us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.744212:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1789065880.744242:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991552 00000100:00100000:1.0:1789065880.744245:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991552 00000100:00100000:1.0:1789065880.744277:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991168 00000100:00100000:1.0:1789065880.744280:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991168 00000100:00100000:1.0:1789065880.744290:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991296 00000100:00100000:1.0:1789065880.744292:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991296 00000100:00100000:1.0:1789065880.744306:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789065880.744312:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257991552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744342:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257991552:12345-0@lo:400:kworker.0 Request processed in 31us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.744349:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789065880.744360:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789065880.744366:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257991168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744391:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971257991168:12345-0@lo:400:kworker.0 Request processed in 25us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.744397:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1789065880.744416:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789065880.744422:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257991296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744452:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257991296:12345-0@lo:400:kworker.0 Request processed in 31us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.744458:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1789065880.744482:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991680 00000100:00100000:1.0:1789065880.744485:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991680 00000100:00100000:1.0:1789065880.744510:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991424 00000100:00100000:1.0:1789065880.744513:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991424 00000100:00100000:1.0:1789065880.744529:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789065880.744535:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257991680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744584:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971257991680:12345-0@lo:400:kworker.0 Request processed in 49us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.744590:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789065880.744601:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789065880.744606:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257991424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744634:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257991424:12345-0@lo:400:kworker.0 Request processed in 28us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.744639:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789065880.744658:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789065880.744661:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065880.744690:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257991424:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744700:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257991296:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744727:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971257991168:0@lo:400:kworker.0 00010000:00080000:1.0:1789065880.744739:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f50f480 x1875971257991680/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065896 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065880.744761:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257991680:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744771:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257991040:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.744780:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257991552:0@lo:400:kworker.0 00000100:00100000:1.0:1789065880.746757:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789065880.746781:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257991808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065880.747046:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065880.748160:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991808 00000100:00100000:0.0:1789065880.748173:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991808 00000100:00100000:0.0:1789065880.748231:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789065880.748241:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257991808:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065880.748280:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065880.748401:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257991808:12345-0@lo:13:osp-pre-1-0.0 Request processed in 161us (1354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065880.748408:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1789065880.752107:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07b1b8e00 x1875971257991808/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065896 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065880.752136:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257991808:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065880.998083:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065880.998128:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065880.998154:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065880.998179:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932672 00000100:00100000:1.0:1789065880.998187:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932672 00000100:00100000:1.0:1789065880.998241:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932544 00000100:00100000:1.0:1789065880.998244:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932544 00000100:00100000:1.0:1789065880.998268:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:1.0:1789065880.998280:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235932672:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065880.998354:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235932672:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 77us (225us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.998362:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:1.0:1789065880.998379:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:1.0:1789065880.998386:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235932544:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065880.998427:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2348:x1875971235932544:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 41us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065880.998433:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00080000:1.0:1789065880.998453:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065880.999072:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932416 00000100:00100000:0.0:1789065880.999079:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932416 00000100:00100000:0.0:1789065880.999117:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 293 00000100:00100000:0.0:1789065880.999125:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235932416:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065880.999167:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235932416:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 43us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065880.999173:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 293 00010000:00010000:1.0:1789065881.575848:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789065882.094768:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789065882.600441:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065883.622277:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065884.645759:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065884.840273:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257991936:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065884.840351:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065884.841682:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257991936 00000100:00100000:2.0:1789065884.841695:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257991936 00000100:00100000:2.0:1789065884.841780:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789065884.841791:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257991936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065884.841830:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789065884.841895:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065884.841902:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257991936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (1552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065884.841909:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789065884.841937:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257991936:0@lo:13:osp-pre-0-0.0 00000001:02000400:3.0:1789065885.170150:0:11846:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 14:44:43 (1789065883) 00010000:00010000:0.0:1789065885.670369:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065885.863927:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257992320:0@lo:400:kworker.0 00000100:00100000:1.0:1789065885.863996:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065885.864076:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065885.864082:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257992448:0@lo:400:kworker.0 00000100:00100000:1.0:1789065885.864109:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065885.864129:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257992192:0@lo:400:kworker.0 00000100:00100000:3.0:1789065885.864159:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065885.864185:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257992704:0@lo:400:kworker.0 00000100:00100000:3.0:1789065885.864205:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065885.864223:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789065885.864228:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257992064:0@lo:400:kworker.0 00000100:00100000:3.0:1789065885.864253:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065885.864254:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992448 00000100:00100000:0.0:1789065885.864262:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992448 00000100:00100000:3.0:1789065885.864290:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257992576:0@lo:400:kworker.0 00000100:00100000:0.0:1789065885.864306:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992704 00000100:00100000:0.0:1789065885.864309:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992704 00000100:00100000:3.0:1789065885.864310:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065885.864377:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789065885.864389:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257992448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065885.864434:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257992448:12345-0@lo:400:kworker.0 Request processed in 49us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065885.864440:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789065885.864519:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789065885.864526:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257992704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065885.864584:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257992704:12345-0@lo:400:kworker.0 Request processed in 58us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065885.864590:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789065885.864613:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789065885.864621:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257992832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065885.864648:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065885.864692:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257992448:0@lo:400:kworker.0 00000100:00100000:0.0:1789065885.864719:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992064 00000100:00100000:0.0:1789065885.864723:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992064 00000100:00100000:0.0:1789065885.864762:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1789065885.864769:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257992064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065885.864797:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257992064:12345-0@lo:400:kworker.0 Request processed in 28us (542us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065885.864810:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00080000:0.0:1789065885.864843:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065885.864860:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992832 00000100:00100000:0.0:1789065885.864864:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992832 00000100:00100000:0.0:1789065885.864888:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789065885.864894:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf080fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257992832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065885.864922:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065885.864956:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf080fc8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257992832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 62us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065885.864961:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:0.0:1789065885.865166:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07b1b8e00 x1875971257992832/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789065901 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065885.865182:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257992832:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065885.865850:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992320 00000100:00100000:1.0:1789065885.865856:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992320 00000100:00100000:1.0:1789065885.865913:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992192 00000100:00100000:1.0:1789065885.865917:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992192 00000100:00100000:1.0:1789065885.865937:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789065885.865944:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257992320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065885.866003:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971257992320:12345-0@lo:400:kworker.0 Request processed in 59us (2008us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065885.866010:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789065885.866196:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789065885.866205:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257992192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065885.866239:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971257992192:12345-0@lo:400:kworker.0 Request processed in 36us (2079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065885.866244:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789065885.866283:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971257992320:0@lo:400:kworker.0 00000100:00080000:0.0:1789065885.868594:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065885.873296:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971257992192:0@lo:400:kworker.0 00010000:00080000:3.0:1789065885.873319:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf050cd3b80 x1875971257992704/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789065901 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065885.873332:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257992704:0@lo:400:kworker.0 00000100:00100000:3.0:1789065885.873359:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257992064:0@lo:400:kworker.0 00000100:00100000:2.0:1789065885.874244:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992576 00000100:00100000:2.0:1789065885.874255:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992576 00000100:00100000:2.0:1789065885.874511:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1789065885.874524:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257992576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065885.874645:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257992576:12345-0@lo:400:kworker.0 Request processed in 124us (10332us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065885.874652:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1789065885.874722:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065885.888995:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257992576:0@lo:400:kworker.0 00000100:00100000:1.0:1789065886.118188:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065886.118231:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065886.118268:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065886.118362:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235933056 00000100:00100000:2.0:1789065886.118373:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235933056 00000100:00100000:2.0:1789065886.118440:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932928 00000100:00100000:2.0:1789065886.118443:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932928 00000100:00100000:2.0:1789065886.118475:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:2.0:1789065886.118485:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235933056:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065886.118619:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235933056:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 135us (387us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065886.118627:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:2.0:1789065886.118645:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00100000:2.0:1789065886.118652:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2347:x1875971235932928:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065886.118678:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2347:x1875971235932928:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 27us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065886.118683:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00080000:1.0:1789065886.119402:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065886.119534:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235932800 00000100:00100000:3.0:1789065886.119540:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235932800 00000100:00100000:3.0:1789065886.119609:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 295 00000100:00100000:3.0:1789065886.119617:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235932800:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065886.119669:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235932800:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 53us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065886.119675:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 295 00010000:00010000:1.0:1789065886.700660:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065887.632625:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065887.632735:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235933184 00000100:00100000:2.0:1789065887.632750:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235933184 00000100:00100000:2.0:1789065887.632831:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:2.0:1789065887.632844:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+5:10237:x1875971235933184:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065887.632874:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065887.637583:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82865 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc6c expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065887.637675:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c8286c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065887.637690:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c8286c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065887.637717:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c8286c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065887.637757:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789065887.637762:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065887.637818:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c8286c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065887.637845:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82865 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc6c expref: 7 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065887.637867:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c8286c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc6c expref: 6 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065887.637877:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065887.638402:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065887.638410:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d200, rc 0) 00000100:00100000:2.0:1789065887.638740:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:10237:x1875971235933184:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 5895us (6129us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065887.638752:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:1.0:1789065887.657851:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065887.663233:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235933312 00000100:00100000:0.0:1789065887.663251:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235933312 00000100:00100000:0.0:1789065887.663331:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1789065887.663343:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:10238:x1875971235933312:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065887.663366:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065887.663389:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82873 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc73 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663460:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663476:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663503:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663519:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663526:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663532:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663802:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fea00/0x7555615576c82888 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663811:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fea00/0x7555615576c82888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663818:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fea00/0x7555615576c82888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065887.663843:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789065887.663846:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065887.663866:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fea00/0x7555615576c82888 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.663877:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664004:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664021:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664027:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065887.664031:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664039:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664050:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:0.0:1789065887.664054:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065887.664059:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664065:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8287a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664077:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664083:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664088:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664093:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065887.664096:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664113:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664122:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cf043eb1800) 00010000:00010000:0.0:1789065887.664125:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065887.664128:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664133:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82881 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664167:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82873 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc73 expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664180:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fea00/0x7555615576c82888 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc73 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.664187:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf043eb1500) 00010000:00010000:0.0:1789065887.664188:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789065887.664191:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fea00, rc 0) 00000100:00100000:0.0:1789065887.664258:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:10238:x1875971235933312:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 917us (6419us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065887.664267:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:1.0:1789065887.673707:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065887.673799:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235933568 00000100:00100000:0.0:1789065887.673811:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235933568 00000100:00100000:0.0:1789065887.673877:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:0.0:1789065887.674007:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:10238:x1875971235933568:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065887.674050:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065887.674074:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8288f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc7a expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674159:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674176:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674189:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674233:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674242:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674250:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674644:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fee00/0x7555615576c828a4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674654:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fee00/0x7555615576c828a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674661:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fee00/0x7555615576c828a4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065887.674671:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:0.0:1789065887.674841:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674849:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674855:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674861:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065887.674865:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.674872:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675027:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf043eb1500) 00010000:00010000:0.0:1789065887.675031:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065887.675037:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675043:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82896 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675056:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675062:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675067:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675082:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065887.675084:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675090:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675098:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf043eb1800) 00010000:00010000:0.0:1789065887.675100:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065887.675103:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.675108:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c8289d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.676498:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8288f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc7a expref: 10 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.676523:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fee00/0x7555615576c828a4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc7a expref: 9 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065887.676530:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:0.0:1789065887.676533:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065887.676536:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fee00, rc 0) 00000100:00100000:0.0:1789065887.676665:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10238:x1875971235933568:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 2652us (2968us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789065887.683583:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:2.0:1789065887.694138:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065887.694415:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235933696 00000100:00100000:0.0:1789065887.694442:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235933696 00000100:00100000:0.0:1789065887.694508:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:0.0:1789065887.694519:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10238:x1875971235933696:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789065887.694684:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10238:x1875971235933696:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 Request processed in 166us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065887.694702:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00010000:00010000:1.0:1789065887.718447:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789065888.231422:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789065888.745042:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789065889.021189:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:1.0:1789065889.765929:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065889.959576:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065889.959607:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257992960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065889.959715:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065889.960064:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257992960 00000100:00100000:2.0:1789065889.960076:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257992960 00000100:00100000:2.0:1789065889.960167:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789065889.960180:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257992960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065889.960227:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065889.960291:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257992960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065889.960298:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789065889.961142:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789065889.961205:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257992960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789065890.410062:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065890.410196:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235933824 00000100:00100000:2.0:1789065890.410212:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235933824 00000100:00100000:2.0:1789065890.410316:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:2.0:1789065890.410333:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10281:x1875971235933824:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065890.410380:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065890.410414:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828b2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc81 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410511:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410529:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410584:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410615:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410623:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410630:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410905:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410915:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410922:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410930:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065890.410941:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410950:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410964:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065890.410968:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065890.410974:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410981:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c828b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.410996:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411002:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411008:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411014:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065890.411017:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411037:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411045:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065890.411047:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065890.411057:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411063:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828c0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411103:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828b2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc81 expref: 9 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411114:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065890.411117:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065890.411120:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828b2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc81 expref: 9 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.411130:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065890.411221:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10281:x1875971235933824:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 894us (1173us total) trans 0 rc 301/301 00000100:00100000:2.0:1789065890.411230:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00080000:1.0:1789065890.411930:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065890.436258:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065890.436362:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934080 00000100:00100000:0.0:1789065890.436376:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934080 00000100:00100000:0.0:1789065890.436454:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1789065890.436468:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10281:x1875971235934080:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:0.0:1789065890.436592:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065890.436633:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c8286c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc6c expref: 8 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.436671:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:0.0:1789065890.436688:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065890.436984:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.437001:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.437014:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.437028:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.437049:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.437057:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065890.438212:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789065890.438233:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.438243:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.438251:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.438258:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065890.438264:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.438274:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.438291:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043eb1a00) 00010000:00010000:0.0:1789065890.438294:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065890.438299:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.438306:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c828c7 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065890.438343:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000002db295cf reply state 00000000586605d5 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065890.438353:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065890.438531:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10281:x1875971235934080:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 2061us (2282us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789065890.438543:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00010000:00010000:1.0:1789065890.443274:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.443323:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.443333:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.443340:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065890.443347:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.443356:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.443380:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf043eb1300) 00010000:00010000:1.0:1789065890.443384:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065890.443391:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.443398:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c828ce lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065890.565043:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065890.565103:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934208 00000100:00100000:2.0:1789065890.565119:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934208 00000100:00100000:2.0:1789065890.565201:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:2.0:1789065890.565213:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10289:x1875971235934208:12345-192.168.204.23@tcp:101:lctl.0 00010000:00010000:2.0:1789065890.565247:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065890.565281:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc88 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.565386:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.565421:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.565438:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065890.565509:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789065890.565514:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065890.565597:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.565629:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc88 expref: 10 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.565665:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc88 expref: 9 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.565675:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065890.565678:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065890.565683:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c200, rc 0) 00000100:00100000:2.0:1789065890.565772:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10289:x1875971235934208:12345-192.168.204.23@tcp:101:lctl.0 Request processed in 560us (746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065890.565781:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:3.0:1789065890.647295:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065890.647916:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934336 00000100:00100000:0.0:1789065890.647932:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934336 00000100:00100000:2.0:1789065890.648163:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:2.0:1789065890.648176:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10295:x1875971235934336:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065890.648204:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065890.648235:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828e3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc8f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648345:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648363:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648377:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648392:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648399:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648406:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648579:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c828f8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648588:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c828f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648596:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c828f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065890.648655:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789065890.648661:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065890.648714:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c828f8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648743:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648751:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648759:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648765:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065890.648771:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648780:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648794:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065890.648798:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065890.648804:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648811:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c828ea lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648829:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648836:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648843:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648856:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065890.648860:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648866:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648875:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9cf042e0f600) 00010000:00010000:2.0:1789065890.648878:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065890.648881:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648887:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c828f1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648926:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c828e3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc8f expref: 11 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648943:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c828f8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc8f expref: 10 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.648951:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:2.0:1789065890.648954:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789065890.648956:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d400, rc 0) 00000100:00100000:2.0:1789065890.649046:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+10:10295:x1875971235934336:12345-192.168.204.23@tcp:101:bash.0 Request processed in 872us (1765us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065890.649054:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:3.0:1789065890.652122:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065890.652918:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934592 00000100:00100000:1.0:1789065890.652933:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934592 00000100:00100000:1.0:1789065890.653015:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:1.0:1789065890.653029:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+10:10295:x1875971235934592:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065890.653058:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065890.653086:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c828ff lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc96 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.653298:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.653322:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.653340:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.655571:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.655596:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.655611:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789065890.656291:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789065890.656906:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.656922:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.656933:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.656967:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.656987:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.656994:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.657000:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065890.657004:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.657012:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.657025:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065890.657028:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065890.657033:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.657040:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82906 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789065890.657060:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000083c88c09 reply state 00000000794d165d transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065890.657071:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789065890.657113:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c828ff lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.657221:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 12 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.657240:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065890.657243:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065890.657245:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072a00, rc 0) 00000100:00100000:1.0:1789065890.657329:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10295:x1875971235934592:12345-192.168.204.23@tcp:101:bash.0 Request processed in 4302us (5221us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1789065890.657338:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00010000:00010000:2.0:1789065890.659001:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.659043:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.659053:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.659060:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065890.659066:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.659074:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.659093:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0b00) 00010000:00010000:2.0:1789065890.659097:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065890.659102:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065890.659108:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8290d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065890.665043:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065890.665268:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934720 00000100:00100000:2.0:1789065890.665281:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934720 00000100:00100000:2.0:1789065890.665345:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:2.0:1789065890.665356:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2346:x1875971235934720:12345-192.168.204.23@tcp:8:bash.0 00010000:00080000:2.0:1789065890.665398:0:6687:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp t0 exp 0000000000000000 cur 349 last 0 00000020:00000080:2.0:1789065890.665441:0:6687:0:(genops.c:1384:class_connect()) connect: client 241917dc-ba0e-425a-830a-a04cd9f8b120, cookie 0x7555615576c82922 00002000:00100000:2.0:1789065890.665457:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 241917dc-ba0e-425a-830a-a04cd9f8b120/ffff9cf050a11000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789065890.665511:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789065890.665830:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789065890.665871:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf050a12800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789065890.665956:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2346:x1875971235934720:12345-192.168.204.23@tcp:8:bash.0 Request processed in 600us (929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065890.665964:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1789065890.671957:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065890.672838:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934848 00000100:00100000:0.0:1789065890.672853:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934848 00000100:00100000:0.0:1789065890.673122:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1789065890.673147:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:0:x1875971235934848:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1789065890.673175:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065890.673210:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdc9d expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789065890.673247:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789065890.673273:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=349s v=(0 0) 00010000:00010000:0.0:1789065890.673278:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065890.673289:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.673315:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.673360:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ff800, rc 0) 00000100:00100000:0.0:1789065890.673463:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:0:x1875971235934848:12345-192.168.204.23@tcp:101:bash.0 Request processed in 319us (1522us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065890.673471:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00080000:1.0:1789065890.674020:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789065890.677426:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065890.677533:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235934976 00000100:00100000:3.0:1789065890.677820:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235934976 00000100:00100000:3.0:1789065890.678058:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:3.0:1789065890.678073:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:10295:x1875971235934976:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065890.678119:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065890.678150:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdca4 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.678191:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.678201:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065890.678205:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065890.678211:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.678255:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.678269:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065890.678285:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875971257993088:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065890.678523:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fef840 going to sleep for 11 seconds 00000100:00100000:2.0:1789065890.682534:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065890.682831:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6687:1875971257993088:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065890.683059:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.683090:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030a00, rc 0) 00000100:00100000:3.0:1789065890.683198:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10295:x1875971235934976:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5128us (5789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065890.683209:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1789065890.685018:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235935104 00000100:00100000:0.0:1789065890.685039:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235935104 00010000:00010000:0.0:1789065890.685106:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065890.685225:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:0.0:1789065890.685237:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971235935104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065890.685257:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065890.685290:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.685307:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.685340:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e70c4630/0x7555615576c82929 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc9d expref: 8 pid: 6688 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.685363:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065890.685368:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065890.685381:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.685412:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.685461:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065890.685479:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1875971257993216:192.168.204.23@tcp:105: 00000100:00100000:0.0:1789065890.685676:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2540 going to sleep for 11 seconds 00000100:00100000:2.0:1789065890.695195:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065890.695316:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235935360 00000100:00100000:1.0:1789065890.695330:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235935360 00000100:00100000:1.0:1789065890.695406:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:1.0:1789065890.695418:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10295:x1875971235935360:12345-192.168.204.23@tcp:35:bash.0 00000001:00080000:1.0:1789065890.695909:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:1.0:1789065890.696070:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10295:x1875971235935360:12345-192.168.204.23@tcp:35:bash.0 Request processed in 652us (887us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789065890.696078:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000020:00080000:1.0:1789065890.696084:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789065890.696375:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1875971257993216:192.168.204.23@tcp:105: 00010000:00010000:0.0:1789065890.696404:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065890.696595:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235935104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 11358us (14075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065890.696607:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00010000:00010000:1.0:1789065890.791220:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065890.798723:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065890.798828:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235935616 00000100:00100000:3.0:1789065890.798843:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235935616 00000100:00100000:3.0:1789065890.798927:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1789065890.798942:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10305:x1875971235935616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065890.798980:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065890.799010:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82937 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcab expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065890.799142:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789065890.799327:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82937 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcab expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.799346:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:3.0:1789065890.799349:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065890.799356:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82937 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcab expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.799375:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030c00, rc 0) 00000100:00100000:3.0:1789065890.799468:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10305:x1875971235935616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 528us (758us total) trans 4294967314 rc 301/301 00000100:00100000:3.0:1789065890.799476:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1789065890.811083:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065890.811228:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235935872 00000100:00100000:1.0:1789065890.811243:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235935872 00000100:00100000:1.0:1789065890.811390:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1789065890.811405:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10305:x1875971235935872:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065890.811832:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10305:x1875971235935872:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 428us (764us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789065890.811841:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789065890.886514:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065890.886704:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235936000 00000100:00100000:1.0:1789065890.886740:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235936000 00000100:00100000:1.0:1789065890.886826:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:1.0:1789065890.886839:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10311:x1875971235936000:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065890.886875:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065890.886907:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82945 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcb2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.887023:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c8294c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.887043:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c8294c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.887062:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c8294c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065890.887117:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789065890.887122:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065890.887149:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c8294c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.887187:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82945 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcb2 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.887215:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c8294c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcb2 expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.887227:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065890.887231:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789065890.887236:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073a00, rc 0) 00000100:00100000:1.0:1789065890.887353:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10311:x1875971235936000:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 516us (856us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065890.887363:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1789065890.893856:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065890.894113:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235936256 00000100:00100000:0.0:1789065890.894128:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235936256 00000100:00100000:0.0:1789065890.894212:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1789065890.894226:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10311:x1875971235936256:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065890.894253:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065890.894282:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82953 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcb9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.894424:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8295a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.894467:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8295a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.894482:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8295a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065890.894498:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789065890.894728:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82953 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcb9 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.894749:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8295a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcb9 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.894759:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:0.0:1789065890.894762:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789065890.894878:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fe800, rc 0) 00000100:00100000:0.0:1789065890.895059:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10311:x1875971235936256:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 834us (1219us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789065890.895068:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:3.0:1789065890.901841:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065890.901919:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065890.902084:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235936640 00000100:00100000:0.0:1789065890.902097:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235936640 00000100:00100000:0.0:1789065890.902188:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1789065890.902200:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:2347:x1875971235936640:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065890.902221:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065890.902255:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c8295a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcb9 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.902293:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:0.0:1789065890.902301:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065890.902372:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2347:x1875971235936640:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 174us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065890.902380:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:1.0:1789065890.902768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235936512 00000100:00100000:1.0:1789065890.902775:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235936512 00000100:00100000:1.0:1789065890.902823:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:1.0:1789065890.902832:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:10311:x1875971235936512:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065890.902857:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065890.902877:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82968 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcc0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.902994:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8296f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.903011:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8296f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.903024:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8296f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065890.903038:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1789065890.903191:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82968 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc0 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.903214:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8296f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065890.903223:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065890.903226:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789065890.903238:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073800, rc 0) 00000100:00100000:1.0:1789065890.903279:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:10311:x1875971235936512:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 449us (1455us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789065890.903286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:1.0:1789065890.915928:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065890.916087:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235936768 00000100:00100000:0.0:1789065890.916101:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235936768 00000100:00100000:0.0:1789065890.916180:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1789065890.916193:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235936768:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1789065890.916256:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.916282:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.916292:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789065890.916298:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789065890.916303:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.916346:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065890.916363:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 7 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065890.916420:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875971257993344:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065890.916964:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789065890.923374:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875971257993344:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065890.923450:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065890.923953:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235936896 00000100:00100000:3.0:1789065890.923965:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235936896 00002000:00100000:3.0:1789065890.924029:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9cf050e71500 x1875971235936896/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:536/0 lens 504/0 e 0 to 0 dl 1789065901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789065890.924042:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf050e71500 with x1875971235936896 ext(0->12) 00010000:00010000:3.0:1789065890.924053:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 8 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065890.924073:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 8 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065890.924082:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf050e71500 00000100:00100000:3.0:1789065890.924121:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1789065890.924132:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971235936896:12345-192.168.204.23@tcp:4:lfs.0 00010000:00010000:0.0:1789065890.925151:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065890.983019:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065890.983051:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257993472:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065890.983149:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065890.983237:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257993472 00000100:00100000:2.0:1789065890.983247:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257993472 00000100:00100000:2.0:1789065890.983328:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789065890.983338:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257993472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065890.983371:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065890.983764:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257993472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 426us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065890.983773:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789065890.983837:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257993472:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1789065890.986138:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065890.988282:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065890.988374:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065890.988403:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257993984:0@lo:400:kworker.0 00000100:00100000:3.0:1789065890.988494:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065890.988589:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257993984 00000100:00100000:3.0:1789065890.988610:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257993984 00000100:00100000:3.0:1789065890.988675:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789065890.988685:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257993984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065890.988754:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257993984:12345-0@lo:400:kworker.0 Request processed in 69us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065890.988761:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789065890.988826:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257993984:0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.989331:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257993856:0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.989386:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065890.989417:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789065890.989424:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257993728:0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.989447:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065890.989480:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257993856 00000100:00100000:0.0:1789065890.989485:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257993856 00000100:00100000:0.0:1789065890.989888:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257993728 00000100:00100000:0.0:1789065890.989894:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257993728 00000100:00100000:0.0:1789065890.989943:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789065890.989952:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257993856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.990007:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257993856:12345-0@lo:400:kworker.0 Request processed in 56us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065890.990015:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789065890.990035:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789065890.990042:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257993728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.990071:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971257993728:12345-0@lo:400:kworker.0 Request processed in 29us (623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065890.990095:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00080000:0.0:1789065890.990119:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065890.990152:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971257993728:0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.990162:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257993856:0@lo:400:kworker.0 00000100:00100000:1.0:1789065890.990465:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257993600:0@lo:400:kworker.0 00000100:00100000:1.0:1789065890.990512:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065890.992488:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257993600 00000100:00100000:0.0:1789065890.992505:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257993600 00000100:00100000:0.0:1789065890.992613:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1789065890.992626:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257993600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065890.992747:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971257993600:12345-0@lo:400:kworker.0 Request processed in 125us (2233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065890.992755:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:1.0:1789065890.992977:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e72300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971257993600:0@lo:400:kworker.0 00000100:00100000:1.0:1789065890.994850:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789065890.994878:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257994112:0@lo:400:kworker.0 00000100:00100000:1.0:1789065890.994979:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065890.995272:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257994112 00000100:00100000:2.0:1789065890.995284:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257994112 00000100:00100000:2.0:1789065890.995392:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1789065890.995403:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257994112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065890.995476:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971257994112:12345-0@lo:400:kworker.0 Request processed in 74us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065890.995483:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789065890.995873:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971257994112:0@lo:400:kworker.0 00000100:00080000:1.0:1789065890.995906:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1789065891.002543:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000100:00100000:0.0:1789065891.005052:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971235936896:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 80903us (81595us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1789065891.005080:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00002000:00100000:0.0:1789065891.005100:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff9cf050e71500 x1875971235936896/t4294967299(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:536/0 lens 504/448 e 0 to 0 dl 1789065901 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065891.005112:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf050e71500 with x1875971235936896 ext(0->12) 00010000:00010000:0.0:1789065891.005127:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 9 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.005155:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 9 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789065891.005165:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf050e71500 00000100:00100000:1.0:1789065891.010123:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065891.010324:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235937024 00000100:00100000:2.0:1789065891.010338:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235937024 00010000:00010000:2.0:1789065891.010398:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 9 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065891.010498:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:2.0:1789065891.010512:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971235937024:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065891.010579:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789065891.010617:0:5824:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789065891.010621:0:5824:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789065890 00002000:00010000:2.0:1789065891.010623:0:5824:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789065890 00002000:00010000:2.0:1789065891.010636:0:5824:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789065890 00010000:00010000:2.0:1789065891.010643:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 9 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.010660:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 9 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.010696:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca770f69/0x7555615576c82930 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdca4 expref: 9 pid: 6687 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.010722:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065891.010749:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065891.010756:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.010995:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.011035:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065891.011117:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971235937024:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 608us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065891.011127:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00010000:00010000:1.0:1789065891.011299:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011311:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011346:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011356:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011374:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011382:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065891.011387:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011397:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011415:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.011423:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000091464c5e/0x7555615576c8297d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065891.011484:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235936768:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 95294us (95573us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065891.011493:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:1.0:1789065891.015759:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065891.015824:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235937280 00000100:00100000:1.0:1789065891.015837:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235937280 00000100:00100000:1.0:1789065891.015899:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1789065891.015911:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+20:10311:x1875971235937280:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:1.0:1789065891.016001:0:5842:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8296f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789065891.016406:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:1.0:1789065891.016458:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:1.0:1789065891.017189:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:1.0:1789065891.017270:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.017290:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.017300:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.017346:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.017366:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 24 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065891.017382:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875971257994240:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065891.017509:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051703b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065891.020699:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd3480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875971257994240:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065891.020745:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065891.022185:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065891.022914:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235937408 00000100:00100000:3.0:1789065891.022931:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235937408 00010000:00010000:3.0:1789065891.022991:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 25 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065891.023043:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:3.0:1789065891.023055:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+25:2348:x1875971235937408:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065891.023075:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065891.023084:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 25 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.023098:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 25 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.023127:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc96 expref: 25 pid: 5838 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.023150:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:3.0:1789065891.023156:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.023168:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.023176:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.023208:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065891.023284:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+24:2348:x1875971235937408:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 230us (1109us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065891.023313:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00010000:00010000:0.0:1789065891.023516:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.023526:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789065891.023931:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:0.0:1789065891.024201:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1789065891.024374:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1ba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971257994368:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789065891.024460:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065891.024502:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065891.025350:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257994368 00000100:00100000:3.0:1789065891.025366:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257994368 00000100:00100000:3.0:1789065891.025436:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789065891.025448:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875971257994368:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789065891.025639:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875971257994368:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 182us (1167us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065891.025648:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065891.026013:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1ba300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971257994368:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789065891.030475:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1789065891.030673:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971257994496:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789065891.030765:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065891.030825:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789065891.031261:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257994496 00000100:00100000:2.0:1789065891.031272:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257994496 00000100:00100000:2.0:1789065891.031342:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789065891.031358:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875971257994496:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789065891.031746:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875971257994496:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 388us (979us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789065891.031755:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789065891.032905:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e70380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971257994496:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789065891.033184:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1789065891.033266:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.033279:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.033288:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.033530:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065891.033537:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.033572:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.033595:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:0.0:1789065891.033599:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789065891.033606:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.033612:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82984 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789065891.034080:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789065891.034797:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789065891.034815:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 350228266478ns, next at 351228263069ns, rc = 0 00000001:00080000:0.0:1789065891.034828:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:0.0:1789065891.034895:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0c00) 00010000:00010000:0.0:1789065891.034899:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789065891.034986:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c8296f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc0 expref: 28 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065891.035212:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+27:10311:x1875971235937280:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 19301us (19467us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1789065891.035231:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000020:00080000:0.0:1789065891.035238:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789065891.038521:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065891.038779:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235937536 00000100:00100000:3.0:1789065891.038793:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235937536 00000100:00100000:3.0:1789065891.038869:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1789065891.038881:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+27:10311:x1875971235937536:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065891.038923:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065891.038956:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c8298b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcc7 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.039043:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c8298b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc7 expref: 28 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.039061:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c8298b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc7 expref: 28 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.039083:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065891.039087:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789065891.039112:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030c00, rc 0) 00000100:00100000:3.0:1789065891.039205:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+28:10311:x1875971235937536:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 321us (695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065891.039213:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1789065891.043902:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065891.044258:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235937792 00000100:00100000:1.0:1789065891.044272:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235937792 00000100:00100000:1.0:1789065891.044398:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1789065891.044411:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+28:10311:x1875971235937792:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065891.044828:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:10311:x1875971235937792:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 417us (939us total) trans 4294967327 rc 0/0 00000100:00100000:1.0:1789065891.044838:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1789065891.155385:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.155609:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235938048 00000100:00100000:0.0:1789065891.155633:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235938048 00000100:00100000:0.0:1789065891.155722:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1789065891.155734:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+29:10321:x1875971235938048:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065891.155780:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065891.155812:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82992 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcce expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065891.155945:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789065891.156101:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82992 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcce expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.156118:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:0.0:1789065891.156122:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789065891.156128:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82992 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcce expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.156146:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ffc00, rc 0) 00000100:00100000:0.0:1789065891.156227:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+30:10321:x1875971235938048:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 494us (857us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1789065891.156236:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:2.0:1789065891.161641:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065891.161907:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235938176 00000100:00100000:3.0:1789065891.161922:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235938176 00000100:00100000:3.0:1789065891.161990:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:3.0:1789065891.162002:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+30:10321:x1875971235938176:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:3.0:1789065891.162110:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162133:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162147:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162166:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162173:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162179:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162301:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162312:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162338:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789065891.162396:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162411:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162417:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162424:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162430:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065891.162434:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162442:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162454:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065891.162457:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065891.162463:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162469:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c829a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162483:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162496:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162502:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162507:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065891.162510:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162517:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162525:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043e52400) 00010000:00010000:3.0:1789065891.162527:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065891.162530:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162536:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c829a7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162616:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162635:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162642:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162647:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065891.162658:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162665:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162674:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065891.162676:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065891.162679:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065891.162686:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c829ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065891.162799:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+30:10321:x1875971235938176:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 797us (1182us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065891.162809:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:3.0:1789065891.168643:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.168788:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235938432 00000100:00100000:0.0:1789065891.168801:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235938432 00000100:00100000:0.0:1789065891.168871:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1789065891.168882:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+30:10321:x1875971235938432:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065891.169182:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+31:10321:x1875971235938432:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 301us (564us total) trans 4294967329 rc 0/0 00000100:00100000:0.0:1789065891.169206:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1789065891.222714:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.224639:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235938688 00000100:00100000:0.0:1789065891.224661:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235938688 00000100:00100000:0.0:1789065891.224763:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:0.0:1789065891.224785:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+31:10324:x1875971235938688:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065891.224818:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065891.224848:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c829b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcd5 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.224956:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.224975:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.224989:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225006:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225013:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225019:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225173:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225207:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225216:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065891.225228:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789065891.225364:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225373:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225382:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225389:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065891.225394:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225403:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225418:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:0.0:1789065891.225421:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065891.225428:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225435:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829bc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225452:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225466:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225473:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225479:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065891.225482:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225489:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225497:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043eb1d00) 00010000:00010000:0.0:1789065891.225499:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065891.225502:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.225509:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.226076:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c829b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.226098:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.226105:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:0.0:1789065891.226108:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789065891.226122:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fec00, rc 0) 00000100:00100000:0.0:1789065891.226216:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10324:x1875971235938688:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1432us (3518us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1789065891.226226:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:2.0:1789065891.248113:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065891.248172:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065891.248203:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065891.248246:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065891.248361:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235938944 00000100:00100000:1.0:1789065891.248376:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235938944 00000100:00100000:1.0:1789065891.248462:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:1.0:1789065891.248475:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235938944:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065891.248640:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235938944:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 167us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065891.248649:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:1.0:1789065891.248681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235939072 00000100:00100000:1.0:1789065891.248685:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235939072 00000100:00100000:1.0:1789065891.248731:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235939200 00000100:00100000:1.0:1789065891.248734:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235939200 00000100:00100000:1.0:1789065891.248758:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:1.0:1789065891.248766:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235939072:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065891.248798:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235939072:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 33us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065891.248805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:1.0:1789065891.248825:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:1.0:1789065891.248832:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10324:x1875971235939200:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:1.0:1789065891.248912:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.248940:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.248957:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.248998:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.249029:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.249037:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.249045:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065891.249051:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.249060:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.249076:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065891.249079:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789065891.249085:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.249091:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c829d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065891.249135:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10324:x1875971235939200:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 303us (887us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065891.249142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00080000:1.0:1789065891.249163:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065891.249495:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235938816 00000100:00100000:0.0:1789065891.249504:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235938816 00000100:00100000:0.0:1789065891.249574:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 297 00000100:00100000:0.0:1789065891.249584:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235938816:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065891.249637:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235938816:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 55us (1539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065891.249644:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 297 00000100:00100000:2.0:1789065891.253251:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.253374:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235939456 00000100:00100000:0.0:1789065891.253391:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235939456 00000100:00100000:0.0:1789065891.253459:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1789065891.253470:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10324:x1875971235939456:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065891.253812:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+34:10324:x1875971235939456:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 342us (573us total) trans 4294967331 rc 0/0 00000100:00100000:0.0:1789065891.253820:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00010000:00010000:1.0:1789065891.815483:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065891.815850:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065891.815895:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235939712 00000100:00100000:2.0:1789065891.815928:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235939712 00000100:00100000:2.0:1789065891.816012:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:2.0:1789065891.816025:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+34:10355:x1875971235939712:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1789065891.816059:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065891.816088:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c829df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcdc expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.816221:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c829e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.816240:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c829e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.816255:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c829e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065891.816270:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789065891.816807:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c829df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcdc expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.816834:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c829e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcdc expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.816844:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065891.816847:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065891.816852:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1de00, rc 0) 00000100:00100000:2.0:1789065891.816943:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:10355:x1875971235939712:12345-192.168.204.23@tcp:101:cat.0 Request processed in 920us (1099us total) trans 4294967332 rc 0/0 00000100:00100000:2.0:1789065891.816953:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:2.0:1789065891.824276:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.824360:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235939840 00000100:00100000:0.0:1789065891.824375:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235939840 00000100:00100000:0.0:1789065891.824473:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:0.0:1789065891.824485:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+36:2347:x1875971235939840:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065891.824507:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065891.824543:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c829e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcdc expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.824644:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:0.0:1789065891.824651:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065891.824722:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e09c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+35:2347:x1875971235939840:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 238us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065891.824730:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:0.0:1789065891.833989:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065891.834319:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235940096 00000100:00100000:1.0:1789065891.834334:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235940096 00000100:00100000:1.0:1789065891.834417:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789065891.834450:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+35:10355:x1875971235940096:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1789065891.835091:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+36:10355:x1875971235940096:12345-192.168.204.23@tcp:35:cat.0 Request processed in 641us (1115us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1789065891.835101:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789065891.932206:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.932409:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235940352 00000100:00100000:0.0:1789065891.932423:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235940352 00000100:00100000:0.0:1789065891.932669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:0.0:1789065891.932685:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+36:10361:x1875971235940352:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:0.0:1789065891.932721:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065891.932726:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789065891.932763:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c8294c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcb2 expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.932803:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:0.0:1789065891.932809:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065891.932828:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829f4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdce3 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.932974:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.932990:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.933023:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.933069:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.933085:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 36 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065891.933101:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257994624:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065891.933488:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065891.942317:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065891.942317:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257994624:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065891.942361:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065891.946620:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235940480 00000100:00100000:1.0:1789065891.946643:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235940480 00010000:00010000:1.0:1789065891.946713:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 37 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065891.946771:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:1.0:1789065891.946783:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+37:2347:x1875971235940480:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065891.946805:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065891.946813:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 37 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.946828:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 37 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.946867:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c829ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcd5 expref: 37 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.946900:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065891.946905:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.946916:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.946944:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.946972:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065891.947060:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:2347:x1875971235940480:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 278us (4757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065891.947067:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00010000:00010000:0.0:1789065891.947226:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.947236:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065891.947262:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789065891.947506:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c829f4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.947526:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065891.947598:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:0.0:1789065891.947601:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789065891.947604:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fe800, rc 0) 00000100:00100000:0.0:1789065891.947659:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+36:10361:x1875971235940352:12345-192.168.204.23@tcp:101:dd.0 Request processed in 14979us (15470us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1789065891.947667:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:3.0:1789065891.964005:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065891.964446:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235940736 00000100:00100000:2.0:1789065891.964460:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235940736 00000100:00100000:2.0:1789065891.964602:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:2.0:1789065891.964626:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:10361:x1875971235940736:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:2.0:1789065891.965148:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.965172:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065891.965187:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065891.965246:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:2.0:1789065891.965271:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000f0f98061 reply state 00000000688fc6e1 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065891.965280:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065891.965749:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+39:10361:x1875971235940736:12345-192.168.204.23@tcp:36:dd.0 Request processed in 1124us (1755us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789065891.965758:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000020:00080000:2.0:1789065891.965765:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789065891.978216:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.978243:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.978254:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.978263:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065891.978270:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.978280:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.978301:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065891.978305:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065891.978312:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065891.978319:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82a09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789065892.327700:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789065892.552212:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065892.558650:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235940864 00000100:00100000:1.0:1789065892.558674:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235940864 00000100:00100000:1.0:1789065892.558789:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1789065892.558815:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+38:10375:x1875971235940864:12345-192.168.204.23@tcp:101:stat.0 00000100:00080000:2.0:1789065892.559114:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789065892.559354:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065892.559385:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcea expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559489:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559507:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559522:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559540:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559587:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559595:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559722:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559756:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559765:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559822:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.559842:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 39 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065892.560658:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257994752:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065892.560948:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051703480 going to sleep for 11 seconds 00000100:00100000:3.0:1789065892.566169:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065892.566672:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235941120 00000100:00100000:0.0:1789065892.566685:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235941120 00000100:00100000:0.0:1789065892.566751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1789065892.566762:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+40:5592:x1875971235941120:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789065892.567231:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+41:5592:x1875971235941120:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 468us (1074us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1789065892.567240:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1789065892.569482:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd0700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257994752:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065892.569527:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065892.572185:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065892.572392:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235941248 00000100:00100000:2.0:1789065892.572405:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235941248 00010000:00010000:2.0:1789065892.572463:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 41 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065892.572528:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:2.0:1789065892.572541:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+41:2347:x1875971235941248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065892.572607:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065892.572617:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 41 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.572633:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 41 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.572661:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c829fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdce3 expref: 41 pid: 5840 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.572684:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065892.572690:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.572702:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.572710:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.572752:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065892.572839:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+40:2347:x1875971235941248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 299us (668us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065892.572847:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00010000:00010000:1.0:1789065892.573410:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573422:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065892.573495:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789065892.573500:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065892.573582:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573628:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573640:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573648:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573654:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573660:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065892.573665:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573674:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573686:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065892.573690:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065892.573694:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573700:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82a17 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573716:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573722:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573735:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573740:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065892.573743:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573748:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573756:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0100) 00010000:00010000:1.0:1789065892.573758:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065892.573761:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573766:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82a1e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573825:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcea expref: 40 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573843:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcea expref: 39 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.573850:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065892.573852:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065892.573864:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072a00, rc 0) 00000100:00100000:1.0:1789065892.573980:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a74bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+39:10375:x1875971235940864:12345-192.168.204.23@tcp:101:stat.0 Request processed in 15171us (21783us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065892.574000:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1789065892.735884:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065892.736064:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235941504 00000100:00100000:1.0:1789065892.736075:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235941504 00000100:00100000:1.0:1789065892.736156:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1789065892.736169:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+39:10381:x1875971235941504:12345-192.168.204.23@tcp:36:truncate.0 00010000:00010000:1.0:1789065892.736237:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065892.736269:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a25 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcea expref: 39 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.736290:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065892.736296:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065892.736531:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.736545:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.736619:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789065892.736675:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:1.0:1789065892.736702:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000a2ed75a9 reply state 00000000d0e1a363 transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065892.736712:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789065892.736838:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+41:10381:x1875971235941504:12345-192.168.204.23@tcp:36:truncate.0 Request processed in 671us (963us total) trans 4294967339 rc 0/0 00000100:00100000:1.0:1789065892.736846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000020:00080000:1.0:1789065892.736864:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789065892.745439:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.745458:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.745487:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.745495:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065892.745500:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.745517:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.745535:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065892.745538:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065892.745544:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065892.745576:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82a2c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065892.839833:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065892.959680:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065892.959973:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235941632 00000100:00100000:0.0:1789065892.959982:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235941632 00000100:00100000:0.0:1789065892.960042:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:0.0:1789065892.960052:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+40:10395:x1875971235941632:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:0.0:1789065892.960075:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065892.960097:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82a33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcf1 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960161:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960176:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960201:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960216:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960223:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960229:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960323:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960331:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960337:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065892.960373:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1789065892.960378:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065892.960401:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960413:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960421:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960437:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960444:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960451:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065892.960455:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960463:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960476:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:0.0:1789065892.960479:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065892.960485:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960491:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82a3a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960506:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960513:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960518:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960523:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065892.960532:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960538:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960545:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043eb1d00) 00010000:00010000:0.0:1789065892.960626:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065892.960629:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960635:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960672:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82a33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960685:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065892.960691:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:0.0:1789065892.960693:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789065892.960696:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fec00, rc 0) 00000100:00100000:0.0:1789065892.960760:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+41:10395:x1875971235941632:12345-192.168.204.23@tcp:101:stat.0 Request processed in 708us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065892.960767:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:3.0:1789065893.091374:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065893.091614:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235941888 00000100:00100000:2.0:1789065893.091625:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235941888 00000100:00100000:2.0:1789065893.091734:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:2.0:1789065893.091745:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+41:10405:x1875971235941888:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065893.091775:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065893.091797:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82a4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcf8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065893.091894:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789065893.092006:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82a4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf8 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.092039:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065893.092042:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065893.092048:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82a4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf8 expref: 43 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.092062:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d800, rc 0) 00000100:00100000:2.0:1789065893.092129:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+42:10405:x1875971235941888:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 386us (764us total) trans 4294967340 rc 301/301 00000100:00100000:2.0:1789065893.092137:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:3.0:1789065893.095319:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065893.095413:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235942144 00000100:00100000:0.0:1789065893.095423:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235942144 00000100:00100000:0.0:1789065893.095472:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1789065893.095481:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+42:10405:x1875971235942144:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065893.095764:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+43:10405:x1875971235942144:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 283us (454us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1789065893.095772:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1789065893.223452:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065893.223609:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235942400 00000100:00100000:0.0:1789065893.223620:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235942400 00000100:00100000:0.0:1789065893.223682:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:0.0:1789065893.223693:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+43:10411:x1875971235942400:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1789065893.223718:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065893.223740:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82a5d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdcff expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065893.223854:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065893.223870:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065893.223879:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065893.223913:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065893.223926:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 44 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065893.223938:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257994880:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065893.224045:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc29c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065893.228782:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.229316:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235942528 00000100:00100000:1.0:1789065893.229329:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235942528 00010000:00010000:1.0:1789065893.229392:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 45 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065893.229427:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9180 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257994880:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065893.229432:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:1.0:1789065893.229448:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+45:2348:x1875971235942528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065893.229450:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229465:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065893.229472:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 45 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229484:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 45 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229505:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82a48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcf1 expref: 45 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229520:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065893.229524:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229533:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229541:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.229626:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065893.229700:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+44:2348:x1875971235942528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 251us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065893.229717:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00010000:00010000:3.0:1789065893.230523:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.230543:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065893.230662:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:3.0:1789065893.230829:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82a5d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 45 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.230847:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.230856:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065893.230859:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789065893.230862:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fe800, rc 0) 00000100:00100000:3.0:1789065893.230922:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+44:10411:x1875971235942400:12345-192.168.204.23@tcp:101:bash.0 Request processed in 7230us (7479us total) trans 4294967342 rc 0/0 00000100:00100000:3.0:1789065893.230930:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1789065893.236475:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.236545:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235942784 00000100:00100000:1.0:1789065893.236597:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235942784 00000100:00100000:1.0:1789065893.236663:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:1.0:1789065893.236674:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+44:10411:x1875971235942784:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:1.0:1789065893.237163:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.237183:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.237196:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789065893.237246:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:1.0:1789065893.237269:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000ec3c6f38 reply state 00000000897505a6 transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065893.237278:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789065893.237360:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10411:x1875971235942784:12345-192.168.204.23@tcp:36:bash.0 Request processed in 688us (893us total) trans 4294967344 rc 0/0 00000100:00100000:1.0:1789065893.237381:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000020:00080000:1.0:1789065893.237386:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1789065893.244656:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1789065893.244991:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.245005:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.245032:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.245039:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065893.245045:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.245053:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.245068:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065893.245071:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065893.245076:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.245083:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82a72 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065893.248232:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235942912 00000100:00100000:3.0:1789065893.248248:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235942912 00000100:00100000:2.0:1789065893.251108:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:2.0:1789065893.251125:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+46:10411:x1875971235942912:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065893.251151:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065893.251174:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82a79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd06 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.251283:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.251298:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.251307:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.251341:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 47 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.251361:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 47 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065893.251390:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e60380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257995008:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065893.251489:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b2206c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065893.255444:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065893.255739:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235943040 00000100:00100000:3.0:1789065893.255752:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235943040 00010000:00010000:3.0:1789065893.255794:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 48 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065893.255835:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:3.0:1789065893.255845:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+48:2348:x1875971235943040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065893.255861:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065893.255882:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 48 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.255905:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 48 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.255932:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065893.255937:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.255946:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.255954:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.255973:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065893.256036:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+48:2348:x1875971235943040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 192us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065893.256044:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00010000:00010000:2.0:1789065893.256202:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82a64 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcff expref: 47 pid: 5840 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065893.256220:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e60380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257995008:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065893.256241:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.256250:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.256255:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065893.256301:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789065893.256305:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065893.256327:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.256359:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82a79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd06 expref: 47 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.256380:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd06 expref: 46 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.256397:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065893.256400:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065893.256403:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ce00, rc 0) 00000100:00100000:2.0:1789065893.256431:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+46:10411:x1875971235942912:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5312us (11786us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065893.256438:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:0.0:1789065893.266774:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.269620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235943296 00000100:00100000:1.0:1789065893.269639:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235943296 00000100:00100000:1.0:1789065893.269850:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:1.0:1789065893.269864:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+46:10411:x1875971235943296:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1789065893.270128:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba5450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10411:x1875971235943296:12345-192.168.204.23@tcp:35:bash.0 Request processed in 267us (3362us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1789065893.270137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:1.0:1789065893.399623:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065893.399729:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235943552 00000100:00100000:2.0:1789065893.399740:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235943552 00000100:00100000:2.0:1789065893.399816:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:2.0:1789065893.399828:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10421:x1875971235943552:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065893.399855:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065893.399879:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82a87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd0d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065893.399984:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:2.0:1789065893.400105:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82a87 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd0d expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.400119:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065893.400121:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065893.400127:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82a87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd0d expref: 49 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065893.400140:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c400, rc 0) 00000100:00100000:2.0:1789065893.400402:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+48:10421:x1875971235943552:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 575us (796us total) trans 4294967346 rc 301/301 00000100:00100000:2.0:1789065893.400429:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:0.0:1789065893.407942:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065893.409789:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235943680 00000100:00100000:3.0:1789065893.409813:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235943680 00000100:00100000:3.0:1789065893.409890:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1789065893.409901:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+48:10421:x1875971235943680:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:3.0:1789065893.409979:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.409995:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410007:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410038:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410045:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410051:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410137:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410146:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410153:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789065893.410196:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410208:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410214:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410222:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410228:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065893.410232:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410247:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410258:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065893.410261:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065893.410266:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410272:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82a95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410288:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410293:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410299:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410305:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065893.410307:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410313:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410320:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043e52400) 00010000:00010000:3.0:1789065893.410322:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065893.410324:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410338:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82a9c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410353:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410359:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410365:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410370:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065893.410373:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410378:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410386:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065893.410388:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065893.410391:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.410396:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82aa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065893.410667:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+48:10421:x1875971235943680:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 765us (2733us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065893.410676:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:0.0:1789065893.422835:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065893.423014:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235943936 00000100:00100000:2.0:1789065893.423024:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235943936 00000100:00100000:2.0:1789065893.423082:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1789065893.423093:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+48:10421:x1875971235943936:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1789065893.423337:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+49:10421:x1875971235943936:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 244us (512us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789065893.423345:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:0.0:1789065893.496735:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.497226:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235944192 00000100:00100000:1.0:1789065893.497237:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235944192 00000100:00100000:1.0:1789065893.497304:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:1.0:1789065893.497329:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+49:10424:x1875971235944192:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065893.497355:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065893.497378:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82aaa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd14 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.497457:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.497473:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.497496:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.497511:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.497518:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.497524:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498041:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82abf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498053:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498060:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82abf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065893.498082:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789065893.498186:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498195:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498201:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498207:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065893.498211:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498218:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498230:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065893.498233:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065893.498238:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498244:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498259:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498265:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498280:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498285:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065893.498287:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498293:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498299:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0100) 00010000:00010000:1.0:1789065893.498301:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065893.498303:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498307:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82ab8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498347:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82aaa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd14 expref: 52 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498361:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82abf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd14 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.498368:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065893.498370:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065893.498373:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073800, rc 0) 00000100:00100000:1.0:1789065893.498427:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10424:x1875971235944192:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1100us (1704us total) trans 4294967348 rc 0/0 00000100:00100000:1.0:1789065893.498444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:0.0:1789065893.503994:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065893.504080:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235944320 00000100:00100000:3.0:1789065893.504091:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235944320 00000100:00100000:3.0:1789065893.504154:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:3.0:1789065893.504164:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10424:x1875971235944320:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:3.0:1789065893.504246:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504266:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504279:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504309:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504316:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504324:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504330:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065893.504334:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504341:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504352:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065893.504355:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065893.504360:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.504382:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82acd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065893.504461:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10424:x1875971235944320:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 298us (822us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065893.504470:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:0.0:1789065893.509028:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065893.511914:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.512124:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235944704 00000100:00100000:1.0:1789065893.512134:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235944704 00000100:00100000:1.0:1789065893.512205:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1789065893.512216:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+51:2349:x1875971235944704:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065893.512233:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065893.512259:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82abf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd14 expref: 51 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.512281:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065893.512286:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065893.512352:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058217100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+50:2349:x1875971235944704:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 137us (449us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065893.512359:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:2.0:1789065893.514924:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235944576 00000100:00100000:2.0:1789065893.514937:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235944576 00000100:00100000:2.0:1789065893.514995:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:2.0:1789065893.515004:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+50:10424:x1875971235944576:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1789065893.515227:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10424:x1875971235944576:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 223us (6207us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789065893.515235:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:0.0:1789065893.784919:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.785139:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235944960 00000100:00100000:1.0:1789065893.785156:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235944960 00000100:00100000:1.0:1789065893.785248:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:1.0:1789065893.785260:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10442:x1875971235944960:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1789065893.785290:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065893.785316:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82ad4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd1b expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.785449:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82adb lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.785466:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.785504:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82adb lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065893.785517:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789065893.785717:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82ad4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd1b expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.785740:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82adb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd1b expref: 53 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.785750:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065893.785754:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789065893.785758:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073200, rc 0) 00000100:00100000:1.0:1789065893.785856:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+53:10442:x1875971235944960:12345-192.168.204.23@tcp:101:cat.0 Request processed in 598us (956us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1789065893.785866:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00010000:00010000:1.0:1789065893.866308:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065893.885711:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065893.885949:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235945088 00000100:00100000:3.0:1789065893.885963:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235945088 00000100:00100000:3.0:1789065893.886038:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1789065893.886050:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+53:10443:x1875971235945088:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065893.886082:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065893.886110:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ae9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd22 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.886200:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82af0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.886219:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.886236:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065893.886284:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789065893.886287:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065893.886306:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82af0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.886698:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ae9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd22 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.887060:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82af0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd22 expref: 54 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.887072:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065893.887075:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789065893.887081:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031600, rc 0) 00000100:00100000:3.0:1789065893.887164:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10443:x1875971235945088:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1115us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065893.887173:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:3.0:1789065893.899985:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065893.901145:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235945472 00000100:00100000:0.0:1789065893.901162:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235945472 00000100:00100000:0.0:1789065893.901316:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1789065893.901330:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10443:x1875971235945472:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065893.901956:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10443:x1875971235945472:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 625us (3633us total) trans 4294967351 rc 0/0 00000100:00100000:0.0:1789065893.901967:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1789065893.911170:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065893.911264:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235945600 00000100:00100000:3.0:1789065893.911279:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235945600 00000100:00100000:3.0:1789065893.911380:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1789065893.911393:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10443:x1875971235945600:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:3.0:1789065893.911418:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789065893.911464:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82a80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd06 expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.911497:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82adb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd1b expref: 54 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.911515:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c8298b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdcc7 expref: 53 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065893.911528:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065893.911630:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065893.911717:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10443:x1875971235945600:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 326us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065893.911726:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1789065893.915351:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.915600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235945728 00000100:00100000:1.0:1789065893.915615:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235945728 00000100:00100000:1.0:1789065893.915698:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:1.0:1789065893.915710:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10443:x1875971235945728:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:1.0:1789065893.915907:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.915931:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.915947:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789065893.916351:0:5839:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789065893.916648:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:1.0:1789065893.916737:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:1.0:1789065893.916893:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10443:x1875971235945728:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 1182us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065893.916904:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:2.0:1789065893.970949:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065893.973176:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235945856 00000100:00100000:1.0:1789065893.973200:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235945856 00000100:00100000:1.0:1789065893.973311:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:1.0:1789065893.973325:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10445:x1875971235945856:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065893.973356:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065893.973387:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82afe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd29 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.973743:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.973879:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.973899:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.973921:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.973930:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.973963:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974090:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974102:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974109:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065893.974157:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1789065893.974162:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065893.974188:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974202:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974213:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974221:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974230:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974237:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065893.974243:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974260:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974274:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065893.974278:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065893.974285:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974291:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b05 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974310:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974317:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974324:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974329:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065893.974333:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974339:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974345:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0500) 00010000:00010000:1.0:1789065893.974348:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065893.974351:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974367:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b0c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974412:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82afe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 54 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.974431:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 53 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065893.975235:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:1.0:1789065893.975241:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789065893.975246:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072a00, rc 0) 00000100:00100000:1.0:1789065893.975360:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+53:10445:x1875971235945856:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2033us (4424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065893.975370:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000001:00080000:3.0:1789065894.214914:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967351 is committed 00000004:00080000:3.0:1789065894.214952:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789065894.214980:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf050bc2b40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789065894.214986:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf050c15d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf050bc20c0 00000020:00080000:3.0:1789065894.214990:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf050c15c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf07ecec400 00000020:00080000:2.0:1789065894.215338:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789065894.215503:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1789065894.215784:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257995136:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789065894.215884:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065894.216032:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257995136 00000100:00100000:2.0:1789065894.216043:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257995136 00000100:00100000:2.0:1789065894.216168:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789065894.216181:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971257995136:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789065894.216219:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789065894.216266:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa2faa2, atime: 0x6aa2faa2, ctime: 0x6aa2faa2, blocks: 0x1 00010000:00010000:2.0:1789065894.216275:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.216314:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=353s v=(0 0) 00010000:00010000:2.0:1789065894.216319:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065894.216327:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.216347:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.216359:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.216367:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.216389:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789065894.217124:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971257995136:12345-0@lo:6:osp-syn-1-0.0 Request processed in 943us (1236us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789065894.217137:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1789065894.217179:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065894.217187:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.217199:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065894.217204:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.217230:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.217255:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.217265:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024e90310/0x7555615576c82b1a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.217293:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065894.217296:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065894.217297:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789065894.217349:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf050cd3480/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789065894.217357:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257995136:0@lo:6:osp-syn-1-0.0 00000100:00080000:1.0:1789065894.226682:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1789065894.374115:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789065894.374128:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789065894.374190:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789065894.374199:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789065894.374395:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf08176aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971257995264:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789065894.374586:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0540 going to sleep for 11 seconds 00000100:00100000:0.0:1789065894.385191:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.385745:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf08176aa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971257995264:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789065894.386877:0:5850:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235945984 00000100:00100000:3.0:1789065894.386894:0:5850:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235945984 00000100:00100000:3.0:1789065894.387023:0:5850:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1789065894.387038:0:5850:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235945984:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1789065894.387156:0:5850:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235945984:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 Request processed in 121us (1979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065894.387165:0:5850:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00080000:1.0:1789065894.387348:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065894.393121:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.393228:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235946112 00000100:00100000:1.0:1789065894.393241:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235946112 00000100:00100000:1.0:1789065894.393333:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:1.0:1789065894.393346:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235946112:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789065894.393393:0:5838:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789065894.393583:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235946112:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 238us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065894.393591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:0.0:1789065894.404251:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.404337:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235946240 00000100:00100000:3.0:1789065894.404351:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235946240 00000100:00100000:3.0:1789065894.404431:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:3.0:1789065894.404443:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235946240:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789065894.404613:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.404657:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.404671:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409796:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409823:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409838:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409876:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409886:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409892:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065894.409940:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789065894.409945:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065894.409967:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.409980:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410004:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410012:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410018:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065894.410384:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410396:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410410:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:3.0:1789065894.410413:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065894.410418:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410424:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82b21 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410440:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410446:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410452:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410456:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065894.410467:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410473:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410481:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9cf043e52400) 00010000:00010000:3.0:1789065894.410483:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065894.410486:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410492:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410510:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410516:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410523:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410527:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065894.410530:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410536:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410544:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:3.0:1789065894.410586:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065894.410596:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.410603:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.410903:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235946240:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 6457us (6661us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065894.410914:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1789065894.417605:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.417894:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235946496 00000100:00100000:2.0:1789065894.417914:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235946496 00000100:00100000:2.0:1789065894.418002:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:2.0:1789065894.418015:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+11:10456:x1875971235946496:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065894.418043:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065894.418071:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82b36 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd30 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418208:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418228:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418254:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065894.418270:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789065894.418608:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418618:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418626:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418634:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065894.418640:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418649:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418792:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:2.0:1789065894.418796:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065894.418803:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418810:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b3d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418865:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82b36 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd30 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418891:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:2.0:1789065894.418894:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065894.418899:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82b36 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd30 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.418910:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065894.419007:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235946496:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 994us (1408us total) trans 4294967352 rc 301/301 00000100:00100000:2.0:1789065894.419016:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:0.0:1789065894.425063:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.425337:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235946624 00000100:00100000:1.0:1789065894.425350:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235946624 00000100:00100000:1.0:1789065894.425426:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:1.0:1789065894.425439:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235946624:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789065894.425496:0:8255:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789065894.425786:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235946624:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 348us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065894.425795:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:1.0:1789065894.435974:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.436269:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235946880 00000100:00100000:2.0:1789065894.436282:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235946880 00000100:00100000:3.0:1789065894.437105:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:3.0:1789065894.437121:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235946880:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065894.437149:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065894.437153:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789065894.437188:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82af0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd22 expref: 12 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.437207:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065894.437213:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789065894.437230:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b4b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd37 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789065894.439176:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1789065894.440239:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.440266:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.440281:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.440819:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b4b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd37 expref: 14 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.440845:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd37 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.440856:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065894.440859:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065894.440862:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030c00, rc 0) 00000100:00100000:3.0:1789065894.441010:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235946880:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 3891us (5051us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1789065894.441021:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:2.0:1789065894.445092:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.445211:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235947136 00000100:00100000:1.0:1789065894.445224:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235947136 00000100:00100000:1.0:1789065894.445299:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:1.0:1789065894.445412:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235947136:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789065894.445500:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065894.445624:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82b52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd37 expref: 13 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.445653:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:1.0:1789065894.445667:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065894.445709:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.445883:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.445897:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.445915:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.445923:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.445930:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446226:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446236:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446244:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446251:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065894.446257:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446266:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446277:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065894.446286:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065894.446292:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446299:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b60 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446314:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446320:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446326:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446331:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065894.446335:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446341:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446348:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe6d738ff (ffff9cf06a8c0500) 00010000:00010000:1.0:1789065894.446351:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065894.446353:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.446359:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b67 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe6d738ff bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065894.446522:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235947136:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1209us (1442us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789065894.446598:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:0.0:1789065894.452607:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.452748:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235947264 00000100:00100000:1.0:1789065894.452761:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235947264 00000100:00100000:1.0:1789065894.452851:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:1.0:1789065894.452864:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235947264:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065894.452891:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065894.452920:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b6e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd3e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.452967:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.452984:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.452998:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.453137:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82b6e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.453159:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.453169:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:1.0:1789065894.453173:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789065894.453177:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073200, rc 0) 00000100:00100000:1.0:1789065894.453262:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235947264:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 400us (730us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065894.453277:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1789065894.456197:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.456308:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235947520 00000100:00100000:3.0:1789065894.456324:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235947520 00000100:00100000:3.0:1789065894.456400:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:3.0:1789065894.456413:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235947520:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789065894.456598:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.456620:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.456635:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789065894.457035:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:3.0:1789065894.457048:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353650498889ns, next at 354650496267ns, rc = 0 00000004:00010000:3.0:1789065894.457174:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000012b8f944 reply state 000000002a0c4c58 transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.457187:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789065894.457318:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10456:x1875971235947520:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 906us (1132us total) trans 4294967354 rc 0/0 00000100:00100000:3.0:1789065894.457327:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00010000:00010000:3.0:1789065894.460813:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.460838:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.460848:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.460856:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065894.460862:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.460871:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.460893:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:3.0:1789065894.460897:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789065894.460903:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.460911:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82b7c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065894.461079:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.461335:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235947648 00000100:00100000:2.0:1789065894.461348:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235947648 00000100:00100000:2.0:1789065894.461419:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:2.0:1789065894.461431:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10456:x1875971235947648:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065894.461462:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065894.461485:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd45 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.461615:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.461632:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.461680:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:2.0:1789065894.461684:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065894.461687:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d200, rc 0) 00000100:00100000:2.0:1789065894.461762:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10456:x1875971235947648:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 333us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065894.461770:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:2.0:1789065894.472216:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.472276:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235947776 00000100:00100000:2.0:1789065894.472290:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235947776 00000100:00100000:2.0:1789065894.472419:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:2.0:1789065894.472430:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875971235947776:12345-192.168.204.23@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789065894.472472:0:6685:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp t0 exp 0000000000000000 cur 353 last 0 00000020:00000080:2.0:1789065894.472520:0:6685:0:(genops.c:1384:class_connect()) connect: client 241917dc-ba0e-425a-830a-a04cd9f8b120, cookie 0x7555615576c82b8a 00002000:00100000:2.0:1789065894.472774:0:6685:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 241917dc-ba0e-425a-830a-a04cd9f8b120/ffff9cf050a11800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789065894.473117:0:6685:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789065894.473623:0:6685:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789065894.473787:0:6685:0:(import.c:65:import_set_state_nolock()) ffff9cf050a14000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789065894.474026:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2346:x1875971235947776:12345-192.168.204.23@tcp:8:lhsmtool_posix.0 Request processed in 1516us (1746us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065894.474037:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1789065894.481891:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.481944:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235947904 00000100:00100000:2.0:1789065894.481968:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235947904 00000100:00100000:2.0:1789065894.482067:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:2.0:1789065894.482079:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:0:x1875971235947904:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1789065894.482175:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1789065894.549222:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:3.0:1789065894.549240:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000100:00100000:2.0:1789065894.550621:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:0:x1875971235947904:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 68526us (68726us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1789065894.550641:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:2.0:1789065894.552217:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.555006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235948160 00000100:00100000:0.0:1789065894.555026:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235948160 00000100:00100000:0.0:1789065894.555128:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:0.0:1789065894.555140:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10456:x1875971235948160:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789065894.555492:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10456:x1875971235948160:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 354us (3287us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1789065894.555501:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1789065894.559310:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.559593:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235948416 00000100:00100000:0.0:1789065894.559608:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235948416 00000100:00100000:0.0:1789065894.559681:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:0.0:1789065894.559693:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10456:x1875971235948416:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789065894.560033:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10456:x1875971235948416:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 340us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065894.560043:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:3.0:1789065894.563744:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.563880:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235948544 00000100:00100000:0.0:1789065894.563897:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235948544 00000100:00100000:0.0:1789065894.563976:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:0.0:1789065894.563989:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10456:x1875971235948544:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065894.564016:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065894.564047:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82b91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd4c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.564173:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82b98 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.564192:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.564205:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065894.564264:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065894.564286:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82b98 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.564318:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82b91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd4c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.564342:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82b98 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd4c expref: 17 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.564352:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:0.0:1789065894.564355:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789065894.564359:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ff800, rc 0) 00000100:00100000:0.0:1789065894.564434:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10456:x1875971235948544:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 449us (705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065894.564442:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:3.0:1789065894.567516:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.567709:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235948672 00000100:00100000:0.0:1789065894.567723:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235948672 00000100:00100000:0.0:1789065894.567803:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:0.0:1789065894.567824:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2347:x1875971235948672:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065894.567930:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065894.567960:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd53 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789065894.567994:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2faa5, blocks: 0x1 00010000:00010000:0.0:1789065894.568020:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=353s v=(0 0) 00010000:00010000:0.0:1789065894.568025:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065894.568036:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.568060:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.568077:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fec00, rc 0) 00000100:00100000:0.0:1789065894.568146:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235948672:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 324us (645us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065894.568154:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1789065894.578675:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.578831:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235948928 00000100:00100000:1.0:1789065894.578845:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235948928 00000100:00100000:1.0:1789065894.578918:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:1.0:1789065894.578931:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10456:x1875971235948928:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789065894.579092:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10456:x1875971235948928:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 163us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065894.579099:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:3.0:1789065894.584836:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.585428:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949056 00000100:00100000:0.0:1789065894.585444:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949056 00000100:00100000:0.0:1789065894.585530:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:0.0:1789065894.585545:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:10456:x1875971235949056:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065894.585605:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065894.585632:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd5a expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.585692:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.585703:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065894.585708:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065894.585714:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.585756:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.585772:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065894.585791:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f481880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257995392:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065894.585923:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2780 going to sleep for 11 seconds 00000100:00100000:1.0:1789065894.589666:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f481880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257995392:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065894.589721:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.589750:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fe800, rc 0) 00000100:00100000:1.0:1789065894.589824:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:10456:x1875971235949056:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 4282us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065894.589836:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:3.0:1789065894.591393:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.591442:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949184 00000100:00100000:3.0:1789065894.591454:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949184 00010000:00010000:3.0:1789065894.591518:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.591584:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1789065894.591595:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c198450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235949184:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065894.591616:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065894.591941:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.591958:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.591988:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d7752b1/0x7555615576c82b9f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd53 expref: 7 pid: 6685 timeout: 453 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.592006:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065894.592011:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065894.592035:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.592046:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.592098:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.592116:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1875971257995520:192.168.204.23@tcp:105: 00000100:00100000:3.0:1789065894.592227:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065894.608112:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1875971257995520:192.168.204.23@tcp:105: 00010000:00010000:1.0:1789065894.608149:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065894.608227:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c198450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235949184:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 16633us (16867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065894.608241:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:3.0:1789065894.622949:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.623721:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949312 00000100:00100000:2.0:1789065894.623738:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949312 00002000:00100000:2.0:1789065894.623809:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cf07b0b0e00 x1875971235949312/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:540/0 lens 504/0 e 0 to 0 dl 1789065905 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065894.623821:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07b0b0e00 with x1875971235949312 ext(0->8) 00002000:00010000:2.0:1789065894.623828:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07b0b0e00 00000100:00100000:2.0:1789065894.623870:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:2.0:1789065894.623882:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235949312:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789065894.625025:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971235949312:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 1133us (2082us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789065894.625042:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00002000:00100000:2.0:1789065894.625054:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9cf07b0b0e00 x1875971235949312/t4294967302(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:540/0 lens 504/448 e 0 to 0 dl 1789065905 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065894.625063:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07b0b0e00 with x1875971235949312 ext(0->8) 00002000:00010000:2.0:1789065894.625070:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07b0b0e00 00000100:00100000:0.0:1789065894.632777:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.633906:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949440 00000100:00100000:2.0:1789065894.633922:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949440 00000100:00100000:2.0:1789065894.633989:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:2.0:1789065894.634000:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10456:x1875971235949440:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789065894.693231:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000020:00080000:3.0:1789065894.693260:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:3.0:1789065894.693279:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789065894.693303:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:3.0:1789065894.693317:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1789065894.693827:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257995648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789065894.693925:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065894.694025:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257995648 00000100:00100000:3.0:1789065894.694036:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257995648 00000100:00100000:3.0:1789065894.694105:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789065894.694116:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971257995648:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789065894.694334:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789065894.694338:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789065893 00002000:00010000:3.0:1789065894.694342:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789065894.694344:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789065893 -> 1789065893 00002000:00010000:3.0:1789065894.694361:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789065894.694418:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971257995648:12345-0@lo:2:osp-syn-0-0.0 Request processed in 303us (494us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1789065894.694428:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789065894.694456:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:3.0:1789065894.694813:0:3296:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07b0b0380/2, rc 0, transno 4294967303 00000100:00100000:3.0:1789065894.694821:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971257995648:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789065894.698168:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235949440:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 64149us (65384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065894.698190:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:3.0:1789065894.705805:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.705850:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949568 00000100:00100000:3.0:1789065894.705861:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949568 00000100:00100000:3.0:1789065894.705926:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:3.0:1789065894.705938:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235949568:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789065894.772147:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235949568:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 66192us (66338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065894.772167:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000001:00080000:3.0:1789065894.772222:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000001:00080000:3.0:1789065894.772247:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000100:00100000:0.0:1789065894.780079:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.780223:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949824 00000100:00100000:1.0:1789065894.780236:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949824 00000100:00100000:1.0:1789065894.780338:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:1.0:1789065894.780352:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235949824:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789065894.780435:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065894.780487:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82b98 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd4c expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.780508:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:1.0:1789065894.780514:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065894.780602:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.780621:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065894.780635:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789065894.780992:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000009d1425c reply state 00000000f2a00379 transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065894.781004:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789065894.781137:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10456:x1875971235949824:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 788us (1073us total) trans 4294967356 rc 0/0 00000100:00100000:1.0:1789065894.781146:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00010000:00010000:2.0:1789065894.785893:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.785937:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.785946:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.785953:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065894.785959:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.785969:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.785994:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:2.0:1789065894.785997:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065894.786004:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.786011:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82bad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065894.786998:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.787131:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235949952 00000100:00100000:0.0:1789065894.787144:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235949952 00000100:00100000:0.0:1789065894.787220:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:0.0:1789065894.787232:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235949952:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789065894.787643:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1789065894.787648:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789065893 -> 1789065892 00002000:00010000:0.0:1789065894.787665:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789065890 00002000:00010000:0.0:1789065894.787668:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789065893 -> 1789065892 00002000:00010000:0.0:1789065894.787671:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789065894.787759:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235949952:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 528us (770us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1789065894.787768:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1789065894.790541:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.790719:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235950208 00000100:00100000:3.0:1789065894.790732:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235950208 00000100:00100000:3.0:1789065894.790809:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:3.0:1789065894.790821:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10456:x1875971235950208:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789065894.790919:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.790963:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.790974:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.791022:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.791039:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 13 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.791056:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971257995776:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065894.791179:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065894.794290:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.794667:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971257995776:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065894.794705:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065894.795518:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235950336 00000100:00100000:0.0:1789065894.795693:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235950336 00010000:00010000:0.0:1789065894.795751:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 14 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065894.795883:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1789065894.795894:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971235950336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065894.795914:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065894.795921:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 14 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.795935:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 14 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.795963:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82b75 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd3e expref: 14 pid: 5839 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.795982:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:0.0:1789065894.795989:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.796000:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.796025:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.796060:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789065894.796202:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796212:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796251:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796258:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796273:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796280:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065894.796285:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796294:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796304:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:3.0:1789065894.796307:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789065894.796312:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.796317:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bb4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065894.796388:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:2347:x1875971235950336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 494us (2113us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065894.796398:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:3.0:1789065894.796760:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235950208:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 5940us (6241us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789065894.796783:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:0.0:1789065894.799757:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.799907:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235950464 00000100:00100000:3.0:1789065894.799921:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235950464 00000100:00100000:3.0:1789065894.800030:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:3.0:1789065894.800043:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235950464:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789065894.800107:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.800131:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.800160:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065894.800166:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065894.800172:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.800221:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.800237:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 7 pid: 6688 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.800254:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257995904:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065894.800362:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065894.803735:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.803933:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235950592 00000100:00100000:2.0:1789065894.803945:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235950592 00010000:00010000:2.0:1789065894.804002:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 8 pid: 6688 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065894.804046:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:2.0:1789065894.804057:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235950592:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065894.804097:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065894.804131:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 8 pid: 6688 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.804146:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 8 pid: 6688 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.804179:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065894.804184:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065894.804191:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.804202:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.804228:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065894.804308:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235950592:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 252us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065894.804317:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00010000:00010000:3.0:1789065894.804879:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091464c5e/0x7555615576c82ba6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd5a expref: 7 pid: 6688 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.804905:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257995904:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065894.804932:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.804944:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.804952:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.804996:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.805005:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.805014:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.805022:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065894.805027:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.805037:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.805052:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.805059:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f27920d/0x7555615576c82bbb lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.805128:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235950464:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 5089us (5666us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065894.805137:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:2.0:1789065894.808374:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065894.808469:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235950848 00000100:00100000:3.0:1789065894.808493:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235950848 00000100:00100000:3.0:1789065894.808606:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:3.0:1789065894.808618:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+12:10456:x1875971235950848:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789065894.808744:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.808778:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.808799:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.809085:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.809098:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.809107:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.809149:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.809165:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 13 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.809180:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257996032:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065894.809295:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1ba80 going to sleep for 11 seconds 00000100:00100000:0.0:1789065894.812440:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065894.812964:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235950976 00000100:00100000:2.0:1789065894.812977:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235950976 00010000:00010000:2.0:1789065894.813039:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 14 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065894.813095:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1789065894.813107:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971235950976:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065894.813146:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065894.813155:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 14 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.813170:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 14 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.813198:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:2.0:1789065894.813205:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.813217:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.813227:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.813252:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065894.813327:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971235950976:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 222us (902us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065894.813335:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00010000:00010000:2.0:1789065894.815076:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82b83 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd45 expref: 13 pid: 5839 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065894.815108:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b3800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257996032:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065894.815140:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.815151:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.815176:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065894.815446:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:2.0:1789065894.815751:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:2.0:1789065894.816358:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1789065894.816644:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971257996160:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789065894.816732:0:8255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065894.817910:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f2aa6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065894.826724:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257996160 00000100:00100000:0.0:1789065894.826747:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257996160 00000100:00100000:2.0:1789065894.832760:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789065894.832790:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8255:x1875971257996160:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789065894.832961:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8255:x1875971257996160:12345-0@lo:1000:mdt00_003.0 Request processed in 175us (16228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065894.832969:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789065894.833022:0:8255:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:2.0:1789065894.833030:0:8255:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07b0b0380, transno 4294967303 00000100:00100000:2.0:1789065894.833056:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971257996160:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789065894.834039:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:2.0:1789065894.834167:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971257996288:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789065894.834238:0:8255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065894.834263:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fefb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065894.834295:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257996288 00000100:00100000:2.0:1789065894.834303:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257996288 00000100:00100000:2.0:1789065894.834345:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065894.834354:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:8255:x1875971257996288:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789065894.836352:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:8255:x1875971257996288:12345-0@lo:1000:mdt00_003.0 Request processed in 1985us (2100us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789065894.836380:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789065894.836741:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971257996288:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789065894.836801:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836814:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836824:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836831:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065894.836837:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836846:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836866:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf06a8c0500) 00010000:00010000:2.0:1789065894.836869:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065894.836875:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836882:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82bc9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836936:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836942:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836961:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836966:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065894.836969:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836975:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836983:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:2.0:1789065894.836986:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065894.836989:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.836995:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82af7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.837023:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.837040:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 16 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.837049:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.837096:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 16 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.837114:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 16 pid: 8255 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065894.837139:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257996416:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065894.837325:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fefb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065894.847310:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065894.847453:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257996416:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065894.847501:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.849905:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235951104 00000100:00100000:3.0:1789065894.849928:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235951104 00010000:00010000:3.0:1789065894.849991:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 17 pid: 8255 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065894.851700:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:3.0:1789065894.851726:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:2347:x1875971235951104:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065894.851751:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065894.851764:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 17 pid: 8255 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.851783:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 17 pid: 8255 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.851812:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82b13 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd29 expref: 17 pid: 8255 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.851831:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:3.0:1789065894.851837:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.851849:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.851858:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065894.851903:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065894.851990:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+16:2347:x1875971235951104:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 275us (4695us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065894.852010:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00010000:00010000:2.0:1789065894.853883:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853903:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853921:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853929:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853937:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853945:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065894.853951:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853959:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853980:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:2.0:1789065894.853983:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065894.853989:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.853996:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c82bd0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854030:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854036:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854041:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854046:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065894.854048:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854054:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854062:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0100) 00010000:00010000:2.0:1789065894.854064:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789065894.854066:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065894.854072:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82bc2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065894.854399:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10456:x1875971235950848:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 45775us (46033us total) trans 4294967361 rc 0/0 00000100:00100000:2.0:1789065894.854412:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00000020:00080000:2.0:1789065894.854420:0:8255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789065894.854805:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789065894.854811:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789065894.854838:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789065894.854845:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065894.861958:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065894.862380:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235951360 00000100:00100000:0.0:1789065894.862394:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235951360 00000100:00100000:0.0:1789065894.862479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:0.0:1789065894.862492:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10456:x1875971235951360:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789065894.863700:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789065894.863909:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:0.0:1789065894.863980:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864001:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864017:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864027:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864046:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864053:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864084:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789065894.864224:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10456:x1875971235951360:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 1729us (2278us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1789065894.864236:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000020:00080000:0.0:1789065894.864244:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789065894.864285:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065894.864293:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864301:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fec00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065894.864306:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864316:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864331:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9cf043eb1b00) 00010000:00010000:0.0:1789065894.864335:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789065894.864340:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864347:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82bd7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065894.864375:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065894.864377:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065894.864379:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065894.886395:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065895.081106:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257996544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065895.081206:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065895.081309:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257996544 00000100:00100000:3.0:1789065895.081320:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257996544 00000100:00100000:3.0:1789065895.081381:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789065895.081392:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971257996544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065895.081425:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789065895.081480:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971257996544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065895.081488:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789065895.081603:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058001880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257996544:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789065895.090975:0:11998:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789065895.090988:0:11998:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789065895.091025:0:11998:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1789065895.091101:0:11998:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065895.295670:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065895.295835:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235951616 00000100:00100000:3.0:1789065895.295846:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235951616 00000100:00100000:3.0:1789065895.295905:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:3.0:1789065895.295917:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:10467:x1875971235951616:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065895.295942:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065895.295963:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82bde lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd61 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.296067:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82be5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.296082:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.296104:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82be5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065895.296132:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789065895.296254:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c82bde lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd61 expref: 20 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.296275:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82be5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd61 expref: 19 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.296284:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065895.296286:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789065895.296290:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031600, rc 0) 00000100:00100000:3.0:1789065895.305810:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10467:x1875971235951616:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 9880us (10145us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1789065895.305824:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:3.0:1789065895.308964:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065895.309108:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235951744 00000100:00100000:2.0:1789065895.309119:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235951744 00000100:00100000:2.0:1789065895.309177:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:2.0:1789065895.309188:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10467:x1875971235951744:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:2.0:1789065895.309269:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309287:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309297:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309311:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309317:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309323:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309594:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309602:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309609:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065895.309648:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309680:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309686:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309692:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309697:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065895.309701:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309782:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309795:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:2.0:1789065895.309798:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065895.309803:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309809:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82bf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309822:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309828:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309833:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309844:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065895.309847:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309852:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309860:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf042e0f500) 00010000:00010000:2.0:1789065895.309863:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065895.309866:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309872:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82bfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309887:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309892:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309897:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309901:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065895.309904:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309910:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309926:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065895.309928:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065895.309931:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.309937:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82c01 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065895.310012:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10467:x1875971235951744:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 826us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065895.310022:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:1.0:1789065895.407823:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065895.407863:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235952000 00000100:00100000:1.0:1789065895.407872:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235952000 00000100:00100000:1.0:1789065895.407924:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:1.0:1789065895.407935:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10470:x1875971235952000:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065895.407957:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065895.407982:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82c08 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd68 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408067:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408083:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408094:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408109:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408117:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408123:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408423:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408433:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408441:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065895.408453:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789065895.408584:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408591:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408597:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408602:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065895.408606:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408613:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408626:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065895.408629:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065895.408634:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82c0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408664:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408669:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408674:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408678:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065895.408681:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408686:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408693:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065895.408695:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065895.408697:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408703:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c16 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408742:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82c08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408756:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 21 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.408768:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:1.0:1789065895.408770:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065895.408773:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072a00, rc 0) 00000100:00100000:1.0:1789065895.408835:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10470:x1875971235952000:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 902us (1024us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789065895.408843:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:3.0:1789065895.412487:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.412599:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235952128 00000100:00100000:0.0:1789065895.412610:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235952128 00000100:00100000:0.0:1789065895.412664:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:0.0:1789065895.412676:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10470:x1875971235952128:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1789065895.412745:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412763:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412776:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412802:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412809:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412816:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412821:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.412834:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412842:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412855:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:0.0:1789065895.412858:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789065895.412863:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.412869:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c2b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065895.418070:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10470:x1875971235952128:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 5377us (5574us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065895.418096:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:3.0:1789065895.428411:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.429876:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235952384 00000100:00100000:0.0:1789065895.429894:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235952384 00000100:00100000:1.0:1789065895.429995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:1.0:1789065895.430007:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10470:x1875971235952384:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065895.430262:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba7450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+22:10470:x1875971235952384:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 256us (1860us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1789065895.430270:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1789065895.461371:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065895.461473:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235952640 00000100:00100000:1.0:1789065895.461483:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235952640 00000100:00100000:1.0:1789065895.461592:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:1.0:1789065895.461604:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+22:9998:x1875971235952640:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065895.461627:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065895.461648:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82c32 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd6f expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.461752:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.461766:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.461793:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.461830:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.461844:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 23 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065895.461859:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971257996672:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065895.461949:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b220300 going to sleep for 11 seconds 00000100:00100000:0.0:1789065895.473023:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065895.473164:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971257996672:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065895.473194:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065895.473415:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235952768 00000100:00100000:2.0:1789065895.473423:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235952768 00010000:00010000:2.0:1789065895.473474:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 24 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065895.473520:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:2.0:1789065895.473530:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+24:2348:x1875971235952768:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065895.473595:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065895.473603:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 24 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.473618:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 24 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.473642:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82c1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd68 expref: 24 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.473677:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:2.0:1789065895.473683:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.473693:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.473701:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.473722:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065895.473780:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+23:2348:x1875971235952768:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 251us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065895.473788:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00010000:00010000:1.0:1789065895.473850:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.473858:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065895.473878:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:1.0:1789065895.474026:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82c32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.474043:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 23 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.474064:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:1.0:1789065895.474067:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789065895.474070:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073a00, rc 0) 00000100:00100000:1.0:1789065895.474097:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+23:9998:x1875971235952640:12345-192.168.204.23@tcp:101:bash.0 Request processed in 12496us (12735us total) trans 4294967367 rc 0/0 00000100:00100000:1.0:1789065895.474104:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:0.0:1789065895.486734:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065895.486822:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953024 00000100:00100000:2.0:1789065895.486834:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953024 00000100:00100000:2.0:1789065895.486902:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:2.0:1789065895.486913:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+23:9998:x1875971235953024:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:2.0:1789065895.487191:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.487207:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.487219:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065895.487275:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:2.0:1789065895.487300:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000001069a833 reply state 0000000073002d85 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065895.487322:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789065895.487386:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:2.0:1789065895.487502:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+27:9998:x1875971235953024:12345-192.168.204.23@tcp:36:bash.0 Request processed in 590us (779us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789065895.487680:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000020:00080000:2.0:1789065895.487687:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1789065895.495068:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.495445:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953152 00000100:00100000:0.0:1789065895.495467:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953152 00000100:00100000:0.0:1789065895.495539:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 90 00000100:00100000:0.0:1789065895.495603:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+27:9998:x1875971235953152:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1789065895.495629:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065895.495650:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82c4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd76 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.495721:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd76 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.495748:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82c4e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd76 expref: 28 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.495770:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:0.0:1789065895.495773:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789065895.495778:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821ff800, rc 0) 00000100:00100000:0.0:1789065895.495839:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+28:9998:x1875971235953152:12345-192.168.204.23@tcp:101:bash.0 Request processed in 239us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065895.495846:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 90 00010000:00010000:3.0:1789065895.496137:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.496147:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.496154:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.496159:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065895.496170:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.496180:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.496191:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:3.0:1789065895.496194:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065895.496198:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.496204:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82c47 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065895.501511:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065895.501671:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953280 00000100:00100000:3.0:1789065895.501687:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953280 00000100:00100000:3.0:1789065895.501768:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1789065895.501781:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:9998:x1875971235953280:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065895.501804:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065895.501833:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd7d expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065895.501871:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2faa4, atime: 0x6aa2faa2, ctime: 0x6aa2faa4, blocks: 0xb 00010000:00010000:3.0:1789065895.502153:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=354s v=(0 0) 00010000:00010000:3.0:1789065895.502160:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065895.502171:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.502192:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.502225:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030c00, rc 0) 00000100:00100000:3.0:1789065895.502314:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:9998:x1875971235953280:12345-192.168.204.23@tcp:101:bash.0 Request processed in 535us (812us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065895.502322:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:2.0:1789065895.509201:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.509284:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953408 00000100:00100000:0.0:1789065895.509300:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953408 00002000:00010000:0.0:1789065895.509351:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789065895.509357:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf0817bd880 with x1875971235953408 ext(0->18446744073709551615) 00002000:00010000:0.0:1789065895.509369:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf0817bd880. 00000100:00100000:0.0:1789065895.509411:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1789065895.509422:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235953408:12345-192.168.204.23@tcp:10:bash.0 00002000:00010000:0.0:1789065895.509977:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789065895.509981:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1789065892 -> 1789065894 00002000:00010000:0.0:1789065895.509984:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1789065890 -> 1789065890 00002000:00010000:0.0:1789065895.509986:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1789065892 -> 1789065894 00002000:00010000:0.0:1789065895.509988:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789065895.510120:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235953408:12345-192.168.204.23@tcp:10:bash.0 Request processed in 686us (920us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789065895.510129:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00002000:00010000:0.0:1789065895.510141:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1789065895.510144:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf0817bd880 with x1875971235953408 ext(0->18446744073709551615) 00002000:00010000:0.0:1789065895.510149:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf0817bd880. 00000100:00100000:2.0:1789065895.641059:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.641209:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953536 00000100:00100000:0.0:1789065895.641224:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953536 00000100:00100000:0.0:1789065895.641370:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:0.0:1789065895.641384:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+27:10484:x1875971235953536:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:0.0:1789065895.641489:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.641512:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.641528:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.641582:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.641593:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.641599:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642178:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642192:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642200:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065895.642260:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642273:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642280:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642288:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642295:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.642489:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642499:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642515:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:0.0:1789065895.642519:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065895.642526:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642533:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c5c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642595:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642603:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642626:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.642631:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.642634:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643036:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643049:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043eb1b00) 00010000:00010000:0.0:1789065895.643052:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065895.643057:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643063:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c63 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643084:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643091:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643096:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643102:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.643105:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643123:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643132:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:0.0:1789065895.643134:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065895.643138:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.643144:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065895.643438:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+27:10484:x1875971235953536:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 2051us (2389us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065895.643450:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:1.0:1789065895.699194:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.699316:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953792 00000100:00100000:0.0:1789065895.699333:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953792 00000100:00100000:0.0:1789065895.699419:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:0.0:1789065895.699432:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+27:10487:x1875971235953792:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065895.699462:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065895.699493:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd84 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.699688:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.699708:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.699723:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.699759:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.699780:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.699788:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700311:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82c86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700324:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82c86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700331:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82c86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065895.700345:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1789065895.700478:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700487:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700496:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700503:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.700509:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700531:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700597:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:0.0:1789065895.700601:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065895.700608:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700615:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82c78 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700632:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700638:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700645:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700651:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.700654:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700660:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700669:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043eb1b00) 00010000:00010000:0.0:1789065895.700672:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065895.700675:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700692:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82c7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.700753:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82c71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd84 expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.702371:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82c86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd84 expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.702391:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:0.0:1789065895.702395:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789065895.702399:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0821fec00, rc 0) 00000100:00100000:0.0:1789065895.702521:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+29:10487:x1875971235953792:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 3088us (3342us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1789065895.702530:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:2.0:1789065895.708178:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065895.708292:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235953920 00000100:00100000:3.0:1789065895.708307:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235953920 00000100:00100000:3.0:1789065895.708394:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:3.0:1789065895.708406:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+29:10487:x1875971235953920:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:3.0:1789065895.708638:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.708661:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.708672:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.708720:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 29 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.708737:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 29 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065895.708755:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073fb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257996800:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065895.709339:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b1986c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065895.713366:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065895.713674:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073fb9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971257996800:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065895.713732:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065895.713852:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235954176 00000100:00100000:1.0:1789065895.713863:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235954176 00000100:00100000:1.0:1789065895.714055:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:1.0:1789065895.714068:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+30:5591:x1875971235954176:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789065895.714677:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+31:5591:x1875971235954176:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 608us (1320us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1789065895.714688:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1789065895.717150:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065895.717252:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235954304 00000100:00100000:3.0:1789065895.717265:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235954304 00010000:00010000:3.0:1789065895.717317:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 31 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065895.717365:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1789065895.717375:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+31:2348:x1875971235954304:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065895.717394:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065895.717402:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 31 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717416:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 31 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717445:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82c39 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd6f expref: 31 pid: 5838 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717480:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:3.0:1789065895.717487:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717499:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717518:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717627:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065895.717695:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817be680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+30:2348:x1875971235954304:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 321us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065895.717704:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00010000:00010000:3.0:1789065895.717736:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717744:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717782:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717791:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717797:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717803:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065895.717808:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717816:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717824:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:3.0:1789065895.717827:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065895.717831:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065895.717848:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82c94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065895.718036:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+29:10487:x1875971235953920:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 9631us (9877us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065895.718046:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:3.0:1789065895.720406:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.721835:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235954560 00000100:00100000:0.0:1789065895.721854:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235954560 00000100:00100000:0.0:1789065895.722004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:0.0:1789065895.722017:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+29:10487:x1875971235954560:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065895.722428:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+30:10487:x1875971235954560:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 411us (2033us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1789065895.722438:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:2.0:1789065895.850011:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065895.850085:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.850188:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235954688 00000100:00100000:0.0:1789065895.850202:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235954688 00002000:00100000:0.0:1789065895.850273:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9cf0817bd500 x1875971235954688/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:541/0 lens 496/0 e 0 to 0 dl 1789065906 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065895.850329:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf0817bd500 with x1875971235954688 ext(0->7) 00002000:00010000:0.0:1789065895.850336:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf0817bd500 00000100:00100000:0.0:1789065895.850377:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1789065895.850390:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2350:x1875971235954688:12345-192.168.204.23@tcp:4:bash.0 00000100:00100000:0.0:1789065895.851169:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2350:x1875971235954688:12345-192.168.204.23@tcp:4:bash.0 Request processed in 776us (1169us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789065895.851181:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00002000:00100000:0.0:1789065895.851190:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->7) req@ffff9cf0817bd500 x1875971235954688/t4294967307(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:541/0 lens 496/448 e 0 to 0 dl 1789065906 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065895.851199:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf0817bd500 with x1875971235954688 ext(0->7) 00002000:00010000:0.0:1789065895.851204:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf0817bd500 00000100:00100000:3.0:1789065895.851424:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235954816 00000100:00100000:3.0:1789065895.851432:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235954816 00000100:00100000:3.0:1789065895.851484:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1789065895.851492:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2350:x1875971235954816:12345-192.168.204.23@tcp:16:kworker.0 00000100:00100000:3.0:1789065895.875741:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065895.875931:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235955072 00000100:00100000:1.0:1789065895.875945:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235955072 00000100:00100000:1.0:1789065895.876022:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:1.0:1789065895.876035:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+30:10498:x1875971235955072:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:1.0:1789065895.876065:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065895.876094:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82c9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd8b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.876193:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.876230:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.876248:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.876268:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.876275:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.876281:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879667:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82cb0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879693:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879709:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82cb0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065895.879724:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789065895.879861:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879870:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879878:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879899:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065895.879905:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879915:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879931:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065895.879935:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065895.879941:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879948:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82ca2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879968:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879974:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879981:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879986:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065895.879989:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.879995:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.880014:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065895.880017:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065895.880020:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.880026:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82ca9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.880095:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82c9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd8b expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.880112:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82cb0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd8b expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.880120:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:1.0:1789065895.880122:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065895.880125:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072800, rc 0) 00000100:00100000:1.0:1789065895.882595:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+32:10498:x1875971235955072:12345-192.168.204.23@tcp:101:cat.0 Request processed in 6544us (6848us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1789065895.882612:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:2.0:1789065895.901662:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065895.901870:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235955328 00000100:00100000:1.0:1789065895.901884:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235955328 00000100:00100000:1.0:1789065895.901953:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:1.0:1789065895.901965:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+32:10498:x1875971235955328:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:1.0:1789065895.904790:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10498:x1875971235955328:12345-192.168.204.23@tcp:35:cat.0 Request processed in 2809us (3126us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1789065895.904809:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00010000:00010000:3.0:1789065895.910530:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789065895.917518:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967307 is committed 00000001:00080000:2.0:1789065895.917599:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000100:00100000:3.0:1789065895.917986:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058085c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235954816:12345-192.168.204.23@tcp:16:kworker.0 Request processed in 66486us (67891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065895.918001:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:2.0:1789065895.943921:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065895.944042:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235955584 00000100:00100000:0.0:1789065895.944056:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235955584 00000100:00100000:0.0:1789065895.944144:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:0.0:1789065895.944157:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10499:x1875971235955584:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1789065895.944241:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789065895.944280:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82cb0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd8b expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944324:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fec00/0x7555615576c82c86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd84 expref: 32 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944340:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff800/0x7555615576c82c4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd76 expref: 31 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944375:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf06a8c0b00) 00010000:00010000:0.0:1789065895.944391:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065895.944418:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944435:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944446:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944462:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944469:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944475:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944867:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944876:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.944886:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789065895.945617:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:0.0:1789065895.945632:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355139083185ns, next at 356139079650ns, rc = 0 00010000:00010000:0.0:1789065895.945746:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945759:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945770:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945780:0:5840:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945787:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945794:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945816:0:5840:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789065895.945847:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945854:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945861:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945868:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.945873:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945883:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945903:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043eb1b00) 00010000:00010000:0.0:1789065895.945906:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789065895.945911:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945918:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ffc00/0x7555615576c82ccc lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945939:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945945:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945951:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945956:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821fe800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065895.945958:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945964:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945971:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:0.0:1789065895.945973:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065895.945976:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065895.945982:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fe800/0x7555615576c82cbe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065895.946005:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000008a92336c reply state 00000000356a5da0 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065895.946015:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065895.946139:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+32:10499:x1875971235955584:12345-192.168.204.23@tcp:36:rm.0 Request processed in 1979us (2227us total) trans 4294967376 rc 0/0 00000100:00100000:0.0:1789065895.946149:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 95 00010000:00010000:2.0:1789065895.946585:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065895.946593:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.946601:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065895.946605:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.946613:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.946635:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9cf043eb1b00) 00010000:00010000:2.0:1789065895.946638:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789065895.946642:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.946648:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82cd3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065895.946665:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065895.946667:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065895.946669:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065895.951901:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.951928:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.951937:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.951945:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065895.951952:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.951961:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.951983:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043eb1e00) 00010000:00010000:1.0:1789065895.951988:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065895.951994:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065895.952001:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821ff200/0x7555615576c82cc5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.008220:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.008492:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235955840 00000100:00100000:3.0:1789065896.008517:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235955840 00000100:00100000:3.0:1789065896.008666:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:3.0:1789065896.008680:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+31:10505:x1875971235955840:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065896.008711:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065896.008740:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82cda lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd92 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.008905:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.008962:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.008976:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.008998:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.009005:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.009012:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789065896.009760:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789065896.009982:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.009998:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010008:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010052:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010060:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010068:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010083:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065896.010089:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010098:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010112:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065896.010116:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065896.010123:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010130:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82ce1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789065896.010147:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000acb128a7 reply state 00000000396b9ced transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065896.010157:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789065896.010196:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82cda lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010214:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.010222:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:3.0:1789065896.010225:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065896.010227:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf041682600, rc 0) 00000100:00100000:3.0:1789065896.010334:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+34:10505:x1875971235955840:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1656us (2130us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789065896.010352:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00080000:0.0:1789065896.010576:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065896.017900:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1789065896.018016:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.018033:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.018042:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.018050:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf041682400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065896.018056:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.018066:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.018090:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043e52c00) 00010000:00010000:3.0:1789065896.018094:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065896.018100:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.018108:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82ce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065896.020741:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235955968 00000100:00100000:1.0:1789065896.020765:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235955968 00000100:00080000:0.0:1789065896.020916:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065896.021778:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:1.0:1789065896.021801:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235955968:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065896.021828:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.021861:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdd99 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789065896.021924:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789065896.021955:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=355s v=(0 0) 00010000:00010000:1.0:1789065896.021961:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065896.021972:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.021997:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.022013:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073a00, rc 0) 00000100:00100000:1.0:1789065896.022115:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817be300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971235955968:12345-192.168.204.23@tcp:101:bash.0 Request processed in 324us (4230us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.022124:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:2.0:1789065896.029143:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.031314:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235956096 00000100:00100000:1.0:1789065896.031340:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235956096 00000100:00100000:1.0:1789065896.031441:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:1.0:1789065896.031456:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10505:x1875971235956096:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065896.031482:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.031511:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdda0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.031639:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 9 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.031651:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065896.031675:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065896.031682:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.031728:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 9 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.031745:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 9 pid: 6685 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065896.031764:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875971257996928:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065896.031907:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05a4fa240 going to sleep for 11 seconds 00000100:00100000:2.0:1789065896.040316:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.040421:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235956224 00000100:00100000:0.0:1789065896.040433:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235956224 00010000:00010000:0.0:1789065896.040487:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 10 pid: 6685 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.040589:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:0.0:1789065896.040600:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c199850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2347:x1875971235956224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065896.040621:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065896.040652:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 10 pid: 6685 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.040667:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 10 pid: 6685 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.040701:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065896.040706:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065896.040716:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.040746:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.040800:0:5825:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 10 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.040818:0:5825:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1875971257997056:192.168.204.23@tcp:105: 00000100:00100000:0.0:1789065896.040928:0:5825:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609c540 going to sleep for 11 seconds 00010000:00010000:1.0:1789065896.042031:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d309d136/0x7555615576c82cfd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd99 expref: 10 pid: 6685 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065896.042058:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875971257996928:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065896.042095:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.042109:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073200, rc 0) 00000100:00100000:1.0:1789065896.042235:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10505:x1875971235956096:12345-192.168.204.23@tcp:101:bash.0 Request processed in 10782us (13107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.042245:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:0.0:1789065896.053654:0:5825:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5825:1875971257997056:192.168.204.23@tcp:105: 00010000:00010000:0.0:1789065896.053694:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065896.053762:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c199850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235956224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 13161us (13460us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.053775:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1789065896.057076:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.059807:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235956480 00000100:00100000:0.0:1789065896.059832:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235956480 00000100:00100000:0.0:1789065896.059939:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1789065896.059953:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+33:10505:x1875971235956480:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:0.0:1789065896.060495:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+34:10505:x1875971235956480:12345-192.168.204.23@tcp:35:bash.0 Request processed in 541us (3432us total) trans 4294967378 rc 0/0 00000100:00100000:0.0:1789065896.060514:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:3.0:1789065896.102138:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257997184:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065896.102233:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065896.102295:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257997312:0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.102328:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065896.102377:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257997824:0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.102406:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065896.102436:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065896.102441:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257997696:0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.102468:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065896.102612:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997184 00000100:00100000:0.0:1789065896.102625:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997184 00000100:00100000:0.0:1789065896.102702:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789065896.102714:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875971257997184:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065896.102780:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065896.102842:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875971257997184:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (608us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.102850:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:0.0:1789065896.102885:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065896.102923:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257997568:0@lo:400:kworker.0 00000100:00100000:0.0:1789065896.102954:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065896.102989:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997696 00000100:00100000:0.0:1789065896.102994:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997696 00000100:00100000:0.0:1789065896.103026:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789065896.103032:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257997696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065896.103065:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971257997696:12345-0@lo:400:kworker.0 Request processed in 33us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.103071:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:0.0:1789065896.103085:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065896.103095:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997824 00000100:00100000:0.0:1789065896.103099:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997824 00000100:00100000:0.0:1789065896.103128:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997568 00000100:00100000:0.0:1789065896.103132:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997568 00000100:00100000:0.0:1789065896.103152:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789065896.103159:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257997824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065896.103192:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971257997824:12345-0@lo:400:kworker.0 Request processed in 34us (785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.103197:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789065896.103208:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789065896.103214:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257997568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065896.103242:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971257997568:12345-0@lo:400:kworker.0 Request processed in 29us (288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.103255:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789065896.103299:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971257997568:0@lo:400:kworker.0 00000100:00080000:0.0:1789065896.103322:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065896.103358:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:0.0:1789065896.103365:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:0.0:1789065896.103387:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257997696:0@lo:400:kworker.0 00000100:00100000:0.0:1789065896.103407:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971257997184:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065896.103419:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971257997824:0@lo:400:kworker.0 00000100:00100000:1.0:1789065896.105488:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997312 00000100:00100000:1.0:1789065896.105509:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997312 00000100:00100000:1.0:1789065896.105611:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789065896.105633:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257997312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065896.105763:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971257997312:12345-0@lo:400:kworker.0 Request processed in 133us (3433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.105783:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1789065896.105851:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971257997312:0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.106077:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257997440:0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.106130:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065896.106178:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257997952:0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.106207:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065896.106242:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997952 00000100:00100000:3.0:1789065896.106249:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997952 00000100:00100000:3.0:1789065896.106286:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789065896.106293:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971257997952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065896.106338:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971257997952:12345-0@lo:400:kworker.0 Request processed in 46us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065896.106344:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789065896.106378:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257997952:0@lo:400:kworker.0 00000100:00100000:2.0:1789065896.106733:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257997440 00000100:00100000:2.0:1789065896.106739:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257997440 00000100:00100000:2.0:1789065896.106784:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1789065896.106792:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257997440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065896.106838:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971257997440:12345-0@lo:400:kworker.0 Request processed in 48us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.106845:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789065896.106916:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae64380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971257997440:0@lo:400:kworker.0 00000001:00080000:3.0:1789065896.204023:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00080000:3.0:1789065896.204052:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:2.0:1789065896.238432:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.239016:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235956608 00000100:00100000:3.0:1789065896.239034:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235956608 00000100:00100000:3.0:1789065896.239199:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:3.0:1789065896.239214:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+34:10521:x1875971235956608:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065896.239255:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065896.239319:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82d0b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdda7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.239419:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82d12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.239446:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.239463:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065896.239509:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789065896.239513:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065896.239546:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82d12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.239717:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82d0b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda7 expref: 36 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.239743:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82d12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda7 expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.239754:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065896.239756:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789065896.239761:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030a00, rc 0) 00000100:00100000:2.0:1789065896.240739:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+35:10521:x1875971235956608:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1522us (2320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.240753:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:3.0:1789065896.247029:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.247237:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235956864 00000100:00100000:2.0:1789065896.247268:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235956864 00000100:00100000:2.0:1789065896.247487:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:2.0:1789065896.247500:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+35:10521:x1875971235956864:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065896.247541:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065896.247667:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82d19 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddae expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.247808:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c82d20 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.247826:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c82d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.247842:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c82d20 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065896.247856:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789065896.248023:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82d19 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddae expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.248047:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c82d20 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddae expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.248089:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:2.0:1789065896.248092:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065896.248097:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c800, rc 0) 00000100:00100000:2.0:1789065896.249778:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+37:10521:x1875971235956864:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2265us (2750us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789065896.249803:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:3.0:1789065896.253101:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.254227:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.254237:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235957120 00000100:00100000:1.0:1789065896.254250:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235957120 00000100:00100000:1.0:1789065896.254459:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:1.0:1789065896.254473:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+37:10521:x1875971235957120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065896.254505:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.254571:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82d2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddb5 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.254704:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82d35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.254723:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.254738:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82d35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065896.254756:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789065896.254936:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82d2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddb5 expref: 40 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.254962:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82d35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddb5 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.254998:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:1.0:1789065896.255001:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789065896.255006:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072c00, rc 0) 00000100:00100000:1.0:1789065896.255098:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+39:10521:x1875971235957120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 629us (2014us total) trans 4294967380 rc 0/0 00000100:00100000:1.0:1789065896.255105:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:2.0:1789065896.255335:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235957248 00000100:00100000:2.0:1789065896.255420:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235957248 00000100:00100000:2.0:1789065896.255475:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1789065896.255484:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+40:2348:x1875971235957248:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065896.255498:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065896.255517:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c82d20 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddae expref: 40 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.255541:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:2.0:1789065896.255574:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065896.255602:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+39:2348:x1875971235957248:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 119us (1384us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.255609:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1789065896.261983:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.264084:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235957376 00000100:00100000:0.0:1789065896.264181:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235957376 00000100:00100000:0.0:1789065896.264413:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1789065896.264428:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235957376:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:0.0:1789065896.264881:0:6880:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.264909:0:6880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.264919:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065896.264924:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789065896.264929:0:6880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.264978:0:6880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 6 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.265016:0:6880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 6 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.265034:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6880:1875971257998080:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065896.265187:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73300 going to sleep for 11 seconds 00000100:00100000:3.0:1789065896.268916:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.270412:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6880:1875971257998080:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065896.270665:0:6880:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.270774:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235957504 00000100:00100000:2.0:1789065896.270786:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235957504 00002000:00100000:2.0:1789065896.270857:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cf073fb9880 x1875971235957504/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:542/0 lens 504/0 e 0 to 0 dl 1789065907 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065896.270867:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf073fb9880 with x1875971235957504 ext(0->8) 00010000:00010000:2.0:1789065896.270876:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 7 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.270892:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 7 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789065896.270900:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf073fb9880 00000100:00100000:2.0:1789065896.270993:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:2.0:1789065896.271006:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235957504:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:2.0:1789065896.272271:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2347:x1875971235957504:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 1258us (3361us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789065896.272286:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00002000:00100000:2.0:1789065896.272314:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9cf073fb9880 x1875971235957504/t4294967302(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:542/0 lens 504/448 e 0 to 0 dl 1789065907 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065896.272325:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf073fb9880 with x1875971235957504 ext(0->8) 00010000:00010000:2.0:1789065896.272335:0:6691:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.272365:0:6691:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789065896.272375:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf073fb9880 00000100:00100000:3.0:1789065896.275256:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.275487:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235957632 00000100:00100000:0.0:1789065896.275512:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235957632 00010000:00010000:0.0:1789065896.275615:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.275670:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:0.0:1789065896.275682:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2349:x1875971235957632:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065896.275702:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789065896.275728:0:8446:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789065896.275731:0:8446:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789065895 00002000:00010000:0.0:1789065896.275734:0:8446:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789065895 00002000:00010000:0.0:1789065896.275737:0:8446:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789065895 00010000:00010000:0.0:1789065896.275743:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.275784:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.275813:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e560bc8/0x7555615576c82d04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda0 expref: 9 pid: 6688 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.275837:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789065896.275842:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789065896.275849:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.275860:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.275895:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065896.276074:0:6880:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276085:0:6880:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276127:0:6880:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276136:0:6880:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276146:0:6880:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276153:0:6880:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065896.276159:0:6880:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276181:0:6880:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276195:0:6880:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.276204:0:6880:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82d43 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.276936:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2349:x1875971235957632:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1248us (1687us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.276949:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:1.0:1789065896.279035:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235957376:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 14590us (17047us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.279056:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:3.0:1789065896.286227:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.291267:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235957888 00000100:00100000:0.0:1789065896.291290:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235957888 00000100:00100000:0.0:1789065896.291448:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1789065896.291463:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+38:10521:x1875971235957888:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:0.0:1789065896.291596:0:5841:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82d35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddb5 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789065896.292004:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1789065896.292057:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:0.0:1789065896.292460:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:0.0:1789065896.292578:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.292600:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.292611:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.292661:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.292682:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 42 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.292700:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1875971257998208:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065896.292841:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73300 going to sleep for 11 seconds 00000100:00100000:0.0:1789065896.296042:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd21f80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1875971257998208:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065896.296086:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065896.299429:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.299627:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958016 00000100:00100000:2.0:1789065896.299642:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958016 00010000:00010000:2.0:1789065896.299702:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 43 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.299762:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1789065896.299774:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+43:2347:x1875971235958016:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065896.299795:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065896.299803:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 43 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.299819:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 43 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.299868:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82cef lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd92 expref: 43 pid: 5839 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.299891:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:2.0:1789065896.299896:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.299906:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.299914:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.300007:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065896.300086:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+42:2347:x1875971235958016:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 313us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.300095:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00010000:00010000:1.0:1789065896.302000:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.302021:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789065896.302208:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1789065896.302901:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1789065896.303063:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971257998336:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789065896.303159:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065896.303274:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059240 going to sleep for 11 seconds 00000100:00100000:0.0:1789065896.303410:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257998336 00000100:00100000:0.0:1789065896.303421:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257998336 00000100:00100000:0.0:1789065896.303892:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789065896.303904:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875971257998336:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789065896.304047:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875971257998336:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 146us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.304056:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789065896.304144:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789065896.304151:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789065896.304179:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf050cd3480, transno 4294967301 00000100:00100000:1.0:1789065896.304214:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971257998336:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789065896.304845:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1789065896.304937:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971257998464:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789065896.304989:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065896.305863:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065896.305921:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257998464 00000100:00100000:2.0:1789065896.305931:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257998464 00000100:00100000:2.0:1789065896.305989:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789065896.305999:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5841:x1875971257998464:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789065896.306259:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5841:x1875971257998464:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 260us (1268us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789065896.306267:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789065896.306372:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058214700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971257998464:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789065896.306758:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1789065896.306819:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.306832:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.306841:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.306848:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065896.306853:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.306862:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.306883:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:1.0:1789065896.306886:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789065896.306893:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.306900:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82d4a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789065896.307166:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789065896.307277:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1789065896.307291:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 355500742063ns, next at 356500739252ns, rc = 0 00000001:00080000:1.0:1789065896.307299:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1789065896.307352:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf043e52900) 00010000:00010000:1.0:1789065896.307356:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789065896.307364:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82d35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddb5 expref: 46 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065896.307950:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba7050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+45:10521:x1875971235957888:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 16487us (21734us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1789065896.307962:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000020:00080000:1.0:1789065896.307970:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789065896.315235:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.315321:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958144 00000100:00100000:1.0:1789065896.315335:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958144 00000100:00100000:1.0:1789065896.315420:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:1.0:1789065896.315441:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+45:10521:x1875971235958144:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065896.315475:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.315516:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82d51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddbc expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.315635:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82d51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddbc expref: 46 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.315655:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82d51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddbc expref: 46 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.315704:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065896.315708:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065896.315713:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073a00, rc 0) 00000100:00100000:1.0:1789065896.316192:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+46:10521:x1875971235958144:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 758us (969us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.316201:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:0.0:1789065896.320147:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.320244:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958400 00000100:00100000:1.0:1789065896.320262:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958400 00000100:00100000:1.0:1789065896.320356:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:1.0:1789065896.320369:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+46:10521:x1875971235958400:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065896.320764:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10521:x1875971235958400:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 396us (632us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1789065896.320773:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1789065896.358868:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.358921:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.358985:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.359138:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958528 00000100:00100000:1.0:1789065896.359153:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958528 00000100:00100000:1.0:1789065896.359224:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 299 00000100:00100000:1.0:1789065896.359236:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235958528:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065896.359350:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2348:x1875971235958528:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 105us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.359359:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 299 00000100:00100000:2.0:1789065896.359536:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958784 00000100:00100000:2.0:1789065896.359542:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958784 00000100:00100000:2.0:1789065896.359636:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:2.0:1789065896.359644:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235958784:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065896.359701:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2348:x1875971235958784:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 56us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.359710:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00080000:1.0:1789065896.359843:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065896.366787:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958656 00000100:00100000:0.0:1789065896.366810:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958656 00000100:00100000:0.0:1789065896.366932:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:0.0:1789065896.366947:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235958656:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065896.367072:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235958656:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 128us (8085us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.367081:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00080000:1.0:1789065896.367262:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065896.443658:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.443997:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235958912 00000100:00100000:2.0:1789065896.444012:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235958912 00000100:00100000:2.0:1789065896.444098:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:2.0:1789065896.444122:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10531:x1875971235958912:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:2.0:1789065896.444240:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444264:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444279:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444296:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444304:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444311:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444429:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444438:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444461:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065896.444900:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444917:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444924:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444932:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444938:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065896.444943:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444951:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444964:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:2.0:1789065896.444968:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065896.444973:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444980:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.444996:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445010:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445016:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445020:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065896.445024:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445030:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445038:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf042e0f500) 00010000:00010000:2.0:1789065896.445041:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065896.445044:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445049:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445067:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445072:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445078:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445082:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065896.445091:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445097:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445118:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065896.445121:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065896.445125:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.445131:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82d66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.445247:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10531:x1875971235958912:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 1136us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.445256:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:2.0:1789065896.520175:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.520443:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235959168 00000100:00100000:3.0:1789065896.520463:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235959168 00000100:00100000:3.0:1789065896.520583:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:3.0:1789065896.520598:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+47:10534:x1875971235959168:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065896.520628:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065896.520657:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82d6d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddc3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.520759:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521223:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521241:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521267:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521275:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521281:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521672:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c82d82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521683:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c82d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.521690:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c82d82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065896.521704:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1789065896.522070:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522079:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522088:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522095:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf041682600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065896.522101:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522209:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522227:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:3.0:1789065896.522230:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065896.522237:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522258:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682600/0x7555615576c82d74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522280:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522287:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522293:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522297:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065896.522300:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522306:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522313:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf043e52c00) 00010000:00010000:3.0:1789065896.522316:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065896.522319:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522324:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c82d7b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522385:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf041682400/0x7555615576c82d6d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddc3 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522402:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c82d82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddc3 expref: 49 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.522418:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:3.0:1789065896.522420:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065896.522424:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654600, rc 0) 00000100:00100000:3.0:1789065896.523196:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+49:10534:x1875971235959168:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2596us (3031us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1789065896.523213:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:3.0:1789065896.527247:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.527727:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235959296 00000100:00100000:2.0:1789065896.527741:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235959296 00000100:00100000:2.0:1789065896.527836:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:2.0:1789065896.527848:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+49:10534:x1875971235959296:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1789065896.528179:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528201:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528215:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528277:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528285:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528293:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528300:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065896.528305:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528313:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528326:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065896.528329:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065896.528335:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.528340:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.530253:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+49:10534:x1875971235959296:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 598us (1213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.530281:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 103 00000100:00100000:2.0:1789065896.532790:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.532898:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235959552 00000100:00100000:1.0:1789065896.532912:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235959552 00000100:00100000:1.0:1789065896.532991:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:1.0:1789065896.533022:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+49:10534:x1875971235959552:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065896.533342:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+50:10534:x1875971235959552:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 320us (564us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1789065896.533350:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:3.0:1789065896.680667:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.682468:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235959808 00000100:00100000:2.0:1789065896.682497:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235959808 00000100:00100000:2.0:1789065896.682657:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:2.0:1789065896.682669:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+50:10544:x1875971235959808:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065896.682706:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065896.682710:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789065896.682746:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c82d12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdda7 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.682772:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:2.0:1789065896.682778:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065896.682797:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d97 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddca expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.682932:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.682949:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.682961:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065896.682974:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789065896.683138:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82d97 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddca expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.683167:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddca expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.683175:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065896.683186:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065896.683190:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065896.683294:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10544:x1875971235959808:12345-192.168.204.23@tcp:101:bash.0 Request processed in 626us (2641us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1789065896.683302:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:2.0:1789065896.689983:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.690162:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235960064 00000100:00100000:1.0:1789065896.690176:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235960064 00000100:00100000:1.0:1789065896.690252:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 105 00000100:00100000:1.0:1789065896.690264:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10544:x1875971235960064:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:1.0:1789065896.690352:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1789065896.690389:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c82d9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddca expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.690415:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c82d82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddc3 expref: 50 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.690428:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065896.690434:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065896.690785:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.690804:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.690815:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789065896.691405:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:1.0:1789065896.691459:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000038c64c62 reply state 00000000c369407f transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065896.691498:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789065896.691663:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10544:x1875971235960064:12345-192.168.204.23@tcp:36:bash.0 Request processed in 1398us (1693us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1789065896.691673:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 105 00000020:00080000:1.0:1789065896.691679:0:8255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789065896.695186:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.695211:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.695221:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.695228:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b072c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065896.695235:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.695244:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.695268:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065896.695271:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065896.695278:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.695285:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dac lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.696494:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.696644:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235960192 00000100:00100000:1.0:1789065896.696676:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235960192 00000100:00100000:1.0:1789065896.696738:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 106 00000100:00100000:1.0:1789065896.696749:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+51:10544:x1875971235960192:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065896.696780:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.696806:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82db3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddd1 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.696938:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.696956:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.696970:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065896.697005:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789065896.697010:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065896.697034:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.697065:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82db3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 53 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.697086:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 52 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.697097:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065896.697100:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065896.697103:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b073200, rc 0) 00000100:00100000:1.0:1789065896.697202:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10544:x1875971235960192:12345-192.168.204.23@tcp:101:bash.0 Request processed in 453us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.697210:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 106 00000100:00100000:2.0:1789065896.701328:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.701735:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235960448 00000100:00100000:1.0:1789065896.701751:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235960448 00000100:00100000:1.0:1789065896.701828:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:1.0:1789065896.701840:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+52:10544:x1875971235960448:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1789065896.702366:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+53:10544:x1875971235960448:12345-192.168.204.23@tcp:35:bash.0 Request processed in 521us (1046us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789065896.702376:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:2.0:1789065896.802056:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.802245:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235960576 00000100:00100000:1.0:1789065896.802259:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235960576 00000100:00100000:1.0:1789065896.802342:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 107 00000100:00100000:1.0:1789065896.802355:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+53:10550:x1875971235960576:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065896.802390:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.802607:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82dc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddd8 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.802704:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.802722:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.802738:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065896.803272:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:1.0:1789065896.803301:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065896.803333:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.803369:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072a00/0x7555615576c82dc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd8 expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.803397:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd8 expref: 54 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.803412:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065896.803415:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789065896.803419:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf06b072c00, rc 0) 00000100:00100000:1.0:1789065896.804084:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10550:x1875971235960576:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1725us (2187us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.804095:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 107 00000100:00100000:2.0:1789065896.813321:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.813588:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235960704 00000100:00100000:1.0:1789065896.813604:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235960704 00000100:00100000:1.0:1789065896.813739:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:1.0:1789065896.813753:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10550:x1875971235960704:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065896.813783:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.813814:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82dcf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdddf expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.813987:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814007:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814055:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814093:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814102:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814110:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814244:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814255:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814262:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065896.814310:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789065896.814314:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065896.814338:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814351:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814361:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814378:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814385:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814393:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf06b073800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065896.814398:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814407:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814423:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065896.814439:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065896.814444:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814451:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073800/0x7555615576c82dd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814469:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814475:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814607:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814615:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065896.814625:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814631:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814639:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065896.814641:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065896.814644:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814649:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6200/0x7555615576c82ddd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814686:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072800/0x7555615576c82dcf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814702:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.814708:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065896.814710:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065896.814713:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7200, rc 0) 00000100:00100000:1.0:1789065896.814805:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10550:x1875971235960704:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1056us (1501us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.814814:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 108 00000100:00100000:2.0:1789065896.820450:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.820592:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.821090:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235960960 00000100:00100000:0.0:1789065896.821104:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235960960 00000100:00100000:0.0:1789065896.821179:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:0.0:1789065896.821193:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10550:x1875971235960960:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065896.821230:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065896.821260:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c82deb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdde6 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821405:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821423:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821432:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821450:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821694:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821711:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.821728:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd20700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257998592:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065896.821883:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.821893:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065896.822051:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961088 00000100:00100000:3.0:1789065896.822058:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961088 00010000:00010000:3.0:1789065896.822094:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 57 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065896.822129:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:3.0:1789065896.822138:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+57:2349:x1875971235961088:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065896.822150:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065896.822157:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 57 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.822191:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fd23480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257998720:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065896.822230:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73300 going to sleep for 11 seconds 00010000:00010000:3.0:1789065896.827463:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 57 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.827534:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:3.0:1789065896.827542:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.827598:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.827607:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065896.827703:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+57:2349:x1875971235961088:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 5563us (7153us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065896.827716:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00010000:00010000:2.0:1789065896.829020:0:5840:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.204.23@tcp) returned -22 from blocking AST (req@0000000071e026c0 x1875971257998592) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 1/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.829048:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7200/0x7555615576c82de4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdddf expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065896.829069:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd20700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257998592:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065896.832394:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.832648:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fd23480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971257998720:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065896.832689:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:0.0:1789065896.832698:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.832712:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.832743:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065896.833096:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961216 00000100:00100000:3.0:1789065896.833107:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961216 00010000:00010000:3.0:1789065896.833157:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065896.833213:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:3.0:1789065896.833224:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+56:2348:x1875971235961216:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065896.833244:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065896.833252:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.833265:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.833292:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073200/0x7555615576c82dba lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd1 expref: 56 pid: 5838 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.833311:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:3.0:1789065896.833315:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.833332:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.833341:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.833373:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065896.833468:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+55:2348:x1875971235961216:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 244us (1087us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065896.833476:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00010000:00010000:2.0:1789065896.833736:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.833746:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065896.833783:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789065896.833997:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c82deb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.834027:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 55 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.834035:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065896.834038:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789065896.834040:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049400, rc 0) 00000100:00100000:2.0:1789065896.834080:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10550:x1875971235960960:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 12891us (13645us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1789065896.834087:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 109 00000100:00100000:1.0:1789065896.838680:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.838940:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961472 00000100:00100000:0.0:1789065896.838956:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961472 00000100:00100000:0.0:1789065896.839044:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789065896.839055:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10550:x1875971235961472:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:0.0:1789065896.839075:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065896.839109:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b073a00/0x7555615576c82d51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddbc expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.839134:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:0.0:1789065896.839141:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065896.839221:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10550:x1875971235961472:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 167us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.839229:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1789065896.847008:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065896.847167:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961600 00000100:00100000:3.0:1789065896.847182:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961600 00000100:00100000:3.0:1789065896.847258:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 110 00000100:00100000:3.0:1789065896.847270:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10550:x1875971235961600:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:3.0:1789065896.847453:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.847475:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065896.847506:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789065896.848088:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:3.0:1789065896.848295:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10550:x1875971235961600:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 1022us (1297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065896.848305:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 110 00000100:00100000:2.0:1789065896.852310:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.852449:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961728 00000100:00100000:1.0:1789065896.852464:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961728 00000100:00100000:1.0:1789065896.853055:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 111 00000100:00100000:1.0:1789065896.853068:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+54:10550:x1875971235961728:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065896.853099:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065896.853130:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdded expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.853233:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.853245:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.853271:0:8255:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.853299:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.853315:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065896.853318:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065896.853322:0:8255:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065896.853330:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7000, rc 0) 00000100:00100000:1.0:1789065896.853476:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10550:x1875971235961728:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 409us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.853492:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 111 00010000:00010000:3.0:1789065896.933802:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789065896.934162:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065896.934170:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065896.934245:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:2.0:1789065896.934255:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065896.934453:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971257998848:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789065896.935050:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fefcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065896.946865:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971257998848:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789065896.950791:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.956004:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961856 00000100:00100000:2.0:1789065896.956028:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961856 00000100:00100000:2.0:1789065896.956135:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00100000:2.0:1789065896.956148:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10551:x1875971235961856:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789065896.956196:0:5839:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789065896.956400:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058002680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10551:x1875971235961856:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 253us (5624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065896.956410:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 112 00000100:00100000:2.0:1789065896.965687:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065896.965840:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235961984 00000100:00100000:0.0:1789065896.965856:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235961984 00000100:00100000:0.0:1789065896.965940:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:0.0:1789065896.965953:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10551:x1875971235961984:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789065896.966060:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.966084:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.966099:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.972917:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.972942:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.972956:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.972995:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973004:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973011:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065896.973059:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789065896.973063:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065896.973077:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973088:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973094:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973102:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973128:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065896.973132:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973140:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973154:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:0.0:1789065896.973157:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065896.973162:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973169:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c82e0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973186:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973193:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973199:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973204:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065896.973207:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973214:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973233:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9cf043eb1000) 00010000:00010000:0.0:1789065896.973235:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065896.973239:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973245:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048800/0x7555615576c82e15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973262:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973268:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973274:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973280:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065896.973283:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973289:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973296:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:0.0:1789065896.973299:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065896.973302:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065896.973308:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c82e1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065896.973416:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10551:x1875971235961984:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 7461us (7743us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065896.973426:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 113 00000100:00100000:3.0:1789065896.980377:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065896.981836:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235962240 00000100:00100000:2.0:1789065896.981853:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235962240 00000100:00100000:2.0:1789065896.981958:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:2.0:1789065896.981981:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+55:10551:x1875971235962240:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065896.982006:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065896.982030:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddf4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982134:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982150:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982161:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065896.982175:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789065896.982286:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982294:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982300:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982305:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065896.982309:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982316:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982342:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065896.982345:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789065896.982350:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982356:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982411:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e23 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddf4 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982421:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:2.0:1789065896.982423:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065896.982428:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddf4 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065896.982437:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1da00, rc 0) 00000100:00100000:2.0:1789065896.982508:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058001c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+56:10551:x1875971235962240:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 541us (2148us total) trans 4294967398 rc 301/301 00000100:00100000:2.0:1789065896.982525:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 114 00000100:00100000:3.0:1789065896.994831:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065896.994957:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235962368 00000100:00100000:1.0:1789065896.994976:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235962368 00000100:00100000:1.0:1789065896.995072:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:1.0:1789065896.995083:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+56:10551:x1875971235962368:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789065896.995149:0:8255:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789065896.995289:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058000380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+56:10551:x1875971235962368:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 207us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065896.995297:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:0.0:1789065897.005373:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.008378:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235962624 00000100:00100000:2.0:1789065897.008394:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235962624 00000100:00100000:2.0:1789065897.008461:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:2.0:1789065897.008472:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+56:10551:x1875971235962624:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065897.008491:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065897.008494:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789065897.008533:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf06b072c00/0x7555615576c82dc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddd8 expref: 56 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.008585:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:2.0:1789065897.008591:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065897.008606:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e38 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcddfb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789065897.009003:0:5839:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789065897.009201:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.009215:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.009224:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.009277:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e38 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddfb expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.009294:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddfb expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.009301:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065897.009303:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065897.009306:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065897.009378:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+57:10551:x1875971235962624:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 907us (4014us total) trans 4294967399 rc 0/0 00000100:00100000:2.0:1789065897.009386:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:3.0:1789065897.027359:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.027484:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235962880 00000100:00100000:1.0:1789065897.027496:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235962880 00000100:00100000:1.0:1789065897.027608:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:1.0:1789065897.027619:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+57:10551:x1875971235962880:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789065897.027677:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065897.027708:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcddfb expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.027729:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:1.0:1789065897.027742:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065897.027763:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.027778:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.027787:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028020:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028055:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028063:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028128:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028135:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028141:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028147:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.028151:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028158:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028165:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065897.028168:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065897.028171:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028176:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e4d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028185:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028196:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028201:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028207:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.028210:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028216:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028222:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3578adad (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065897.028224:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065897.028226:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.028231:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c82e54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3578adad bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065897.028322:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a749500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+56:10551:x1875971235962880:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 704us (971us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789065897.028330:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:1.0:1789065897.036649:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.036743:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235963008 00000100:00100000:2.0:1789065897.036763:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235963008 00000100:00100000:2.0:1789065897.036826:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:2.0:1789065897.036836:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+56:10551:x1875971235963008:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065897.036857:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065897.036882:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e5b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde02 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.036919:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.036932:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.036944:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.037058:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e5b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 58 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.037077:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 57 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.037086:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065897.037090:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789065897.037093:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d800, rc 0) 00000100:00100000:2.0:1789065897.037160:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+57:10551:x1875971235963008:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 325us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.037168:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:0.0:1789065897.048169:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.048276:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235963264 00000100:00100000:2.0:1789065897.048289:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235963264 00000100:00100000:2.0:1789065897.048354:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:2.0:1789065897.048365:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+57:10551:x1875971235963264:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789065897.048476:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.048500:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.048521:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789065897.048800:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:2.0:1789065897.048809:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356242260391ns, next at 357242258168ns, rc = 0 00000004:00010000:2.0:1789065897.048887:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000071e026c0 reply state 00000000afaf1bbe transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.048896:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065897.048992:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+59:10551:x1875971235963264:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 628us (832us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789065897.048998:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00010000:00010000:3.0:1789065897.052973:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.052993:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.053001:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.053007:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065897.053013:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.053020:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.053049:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065897.053053:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789065897.053058:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.053064:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c82e69 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.055134:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.055237:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235963392 00000100:00100000:2.0:1789065897.055248:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235963392 00000100:00100000:2.0:1789065897.055303:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:2.0:1789065897.055315:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+58:10551:x1875971235963392:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065897.055347:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065897.055372:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde09 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.055454:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.055468:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 59 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.055487:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065897.055490:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065897.055494:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065897.055907:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+59:10551:x1875971235963392:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 592us (781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.055915:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:1.0:1789065897.065318:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.065878:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235963520 00000100:00100000:2.0:1789065897.065890:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235963520 00000100:00100000:2.0:1789065897.065951:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:2.0:1789065897.065961:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235963520:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789065897.066643:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235963520:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 680us (1332us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789065897.066653:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:2.0:1789065897.083645:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065897.083827:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235963776 00000100:00100000:0.0:1789065897.083841:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235963776 00000100:00100000:0.0:1789065897.083915:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:0.0:1789065897.083929:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+59:10551:x1875971235963776:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789065897.084300:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+60:10551:x1875971235963776:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 370us (667us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789065897.084309:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:0.0:1789065897.087037:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.087907:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964032 00000100:00100000:2.0:1789065897.087923:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964032 00000100:00100000:2.0:1789065897.088019:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:2.0:1789065897.088032:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+60:10551:x1875971235964032:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789065897.088226:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+60:10551:x1875971235964032:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 196us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.088256:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 121 00000100:00100000:3.0:1789065897.091492:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.092433:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964160 00000100:00100000:1.0:1789065897.092452:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964160 00000100:00100000:1.0:1789065897.092590:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:1.0:1789065897.092621:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+60:10551:x1875971235964160:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065897.092645:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065897.092669:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e77 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde10 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.092762:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.092778:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.092792:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065897.092833:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065897.092854:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.092884:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82e77 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde10 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.092904:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde10 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.092912:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065897.092915:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789065897.092919:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7c00, rc 0) 00000100:00100000:1.0:1789065897.092992:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+61:10551:x1875971235964160:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 375us (1516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065897.093008:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:3.0:1789065897.098350:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065897.098668:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964288 00000100:00100000:0.0:1789065897.098683:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964288 00000100:00100000:0.0:1789065897.098763:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:0.0:1789065897.098777:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235964288:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065897.098803:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065897.098831:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde17 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789065897.098869:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2faa8, blocks: 0x1 00010000:00010000:0.0:1789065897.099079:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1789065897.099087:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065897.099126:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.099151:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.099168:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b048600, rc 0) 00000100:00100000:0.0:1789065897.099952:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235964288:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1171us (1613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065897.099965:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:0.0:1789065897.106011:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065897.106664:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964544 00000100:00100000:3.0:1789065897.106679:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964544 00000100:00100000:3.0:1789065897.106756:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1789065897.106787:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+61:10551:x1875971235964544:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789065897.107381:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+61:10551:x1875971235964544:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 594us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065897.107392:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 123 00000100:00100000:3.0:1789065897.124224:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.124414:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964672 00000100:00100000:1.0:1789065897.124438:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964672 00000100:00100000:1.0:1789065897.124530:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:1.0:1789065897.124543:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+8:10551:x1875971235964672:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065897.124608:0:6880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065897.124635:0:6880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde1e expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.124677:0:6880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.124686:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065897.124691:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065897.124697:0:6880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 9 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.124739:0:6880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.124754:0:6880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065897.124770:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6880:1875971257998976:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065897.124885:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059780 going to sleep for 11 seconds 00000100:00100000:2.0:1789065897.132599:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.132739:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6880:1875971257998976:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065897.132813:0:6880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 9 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.132844:0:6880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7600, rc 0) 00000100:00100000:1.0:1789065897.132958:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:10551:x1875971235964672:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 8416us (8761us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065897.132970:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:3.0:1789065897.133231:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964800 00000100:00100000:3.0:1789065897.133241:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964800 00010000:00010000:3.0:1789065897.133288:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065897.133329:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:3.0:1789065897.133341:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2347:x1875971235964800:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065897.133360:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065897.133396:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.133410:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.133442:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000710975b5/0x7555615576c82e85 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde17 expref: 9 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.133462:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065897.133466:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065897.133476:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.133520:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.133583:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065897.133599:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1875971257999104:192.168.204.23@tcp:105: 00000100:00100000:3.0:1789065897.133670:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050d5a600 going to sleep for 11 seconds 00000100:00100000:2.0:1789065897.143103:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5823:1875971257999104:192.168.204.23@tcp:105: 00010000:00010000:2.0:1789065897.143143:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065897.143231:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c19b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235964800:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 9890us (10646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.143246:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:0.0:1789065897.148527:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.149146:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235964928 00000100:00100000:2.0:1789065897.149164:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235964928 00002000:00100000:2.0:1789065897.149258:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cf07ae64380 x1875971235964928/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:543/0 lens 504/0 e 0 to 0 dl 1789065908 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065897.149273:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07ae64380 with x1875971235964928 ext(0->12) 00002000:00010000:2.0:1789065897.149281:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07ae64380 00000100:00100000:2.0:1789065897.149316:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:2.0:1789065897.149329:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2350:x1875971235964928:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789065897.150310:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2350:x1875971235964928:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 976us (1803us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789065897.150324:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00002000:00100000:2.0:1789065897.150333:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9cf07ae64380 x1875971235964928/t4294967309(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:543/0 lens 504/448 e 0 to 0 dl 1789065908 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065897.150343:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07ae64380 with x1875971235964928 ext(0->12) 00002000:00010000:2.0:1789065897.150350:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07ae64380 00000100:00100000:3.0:1789065897.158350:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.165968:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235965056 00000100:00100000:1.0:1789065897.165993:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235965056 00000100:00100000:1.0:1789065897.166091:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 124 00000100:00100000:1.0:1789065897.166115:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+61:10551:x1875971235965056:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789065897.253796:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+61:10551:x1875971235965056:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 87677us (95444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065897.253814:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 124 00000001:00080000:3.0:1789065897.254669:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:3.0:1789065897.254706:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:3.0:1789065897.254759:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:3.0:1789065897.254779:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf05f059240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1789065897.254785:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf051bbcc00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf05f059c00 00000020:00080000:3.0:1789065897.254788:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf051bbcf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf050ba0800 00000004:00080000:3.0:1789065897.254829:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789065897.254853:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf050fefc00 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1789065897.254857:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07f293600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf050fefe40 00000020:00080000:3.0:1789065897.254860:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07f293300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf050f35800 00000100:00100000:2.0:1789065897.255175:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065897.255201:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257999232:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789065897.255316:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065897.255410:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257999232 00000100:00100000:2.0:1789065897.255420:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257999232 00000100:00100000:2.0:1789065897.255481:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789065897.255506:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971257999232:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789065897.255608:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1789065897.255644:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.255675:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.255685:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789065897.255690:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065897.255695:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.255729:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 9 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.255746:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 9 pid: 6685 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.255758:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257999488:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065897.255817:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fefcc0 going to sleep for 11 seconds 00000020:00080000:2.0:1789065897.256735:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1789065897.257097:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789065897.257247:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257999360:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789065897.257322:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065897.257384:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257999360 00000100:00100000:0.0:1789065897.257393:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257999360 00000100:00100000:0.0:1789065897.257447:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789065897.257457:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971257999360:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789065897.257685:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789065897.257690:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789065896 00002000:00010000:0.0:1789065897.257693:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789065897.257695:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789065896 -> 1789065896 00002000:00010000:0.0:1789065897.257697:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789065897.257748:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971257999360:12345-0@lo:2:osp-syn-0-0.0 Request processed in 291us (426us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1789065897.257756:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000004:00080000:0.0:1789065897.257827:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07f55df80/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789065897.257835:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257999360:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789065897.258220:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789065897.258233:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257999616:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789065897.258280:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065897.258313:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971257999616 00000100:00100000:1.0:1789065897.258318:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971257999616 00000100:00100000:1.0:1789065897.258350:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789065897.258357:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971257999616:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789065897.258378:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:1.0:1789065897.258417:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa2faa7, atime: 0x6aa2faa7, ctime: 0x6aa2faa7, blocks: 0x1 00010000:00010000:1.0:1789065897.258426:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.258457:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1789065897.258463:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065897.258470:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.258489:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.258500:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.258518:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.258541:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789065897.259142:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971257999616:12345-0@lo:6:osp-syn-1-0.0 Request processed in 783us (860us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1789065897.259151:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00010000:1.0:1789065897.259178:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789065897.259186:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.259196:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065897.259201:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.259225:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.259247:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.259254:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d87c4d22/0x7555615576c82e9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.259280:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065897.259282:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065897.259284:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789065897.259327:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07b0b0700/2, rc 0, transno 4294967304 00000100:00100000:1.0:1789065897.259336:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971257999616:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789065897.261101:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.261398:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257999488:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065897.261436:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.261600:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.261695:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235965312 00000100:00100000:2.0:1789065897.261704:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235965312 00010000:00010000:2.0:1789065897.261750:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 10 pid: 6685 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.261794:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:2.0:1789065897.261805:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2347:x1875971235965312:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065897.261825:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065897.261831:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 10 pid: 6685 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.261844:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 10 pid: 6685 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.261871:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037db8002/0x7555615576c82c55 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd7d expref: 10 pid: 6685 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.262023:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065897.262029:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065897.262037:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.262070:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.262145:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065897.262235:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2347:x1875971235965312:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 430us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.262244:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:1.0:1789065897.262421:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235965184 00000100:00100000:1.0:1789065897.262428:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235965184 00000100:00100000:1.0:1789065897.262465:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:1.0:1789065897.262472:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971235965184:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00010000:00010000:3.0:1789065897.265828:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.265858:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.265895:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.265905:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.265943:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789065897.267126:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971257999232:12345-0@lo:6:osp-syn-0-0.0 Request processed in 11614us (11802us total) trans 4294967311 rc 0/0 00000100:00100000:3.0:1789065897.267142:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:0.0:1789065897.267465:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065897.267487:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.267501:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065897.267514:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.267527:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.267592:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.267602:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024e90310/0x7555615576c82e93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.267630:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065897.267633:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065897.267634:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789065897.267874:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07f55dc00/2, rc 0, transno 4294967311 00000100:00100000:3.0:1789065897.267884:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971257999232:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789065897.303104:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971235965184:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 40615us (41998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065897.303122:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000001:00080000:3.0:1789065897.305007:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000001:00080000:3.0:1789065897.305035:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1789065897.306746:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.307026:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235965568 00000100:00100000:1.0:1789065897.307041:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235965568 00000100:00100000:1.0:1789065897.307128:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:1.0:1789065897.307141:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10551:x1875971235965568:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789065897.307218:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065897.307256:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde10 expref: 15 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.307299:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065897.307307:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789065897.307350:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.307367:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.307378:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789065897.308071:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000000c5d0033 reply state 00000000a7dee004 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065897.308086:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789065897.308229:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+16:10551:x1875971235965568:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1087us (1493us total) trans 4294967402 rc 0/0 00000100:00100000:1.0:1789065897.308238:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 125 00000100:00100000:2.0:1789065897.312076:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065897.312178:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235965696 00000100:00100000:3.0:1789065897.312192:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235965696 00000100:00100000:3.0:1789065897.312269:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:3.0:1789065897.312281:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235965696:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789065897.312622:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1789065897.312627:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1789065896 -> 1789065896 00002000:00010000:3.0:1789065897.312629:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789065895 00002000:00010000:3.0:1789065897.312632:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1789065896 -> 1789065896 00002000:00010000:3.0:1789065897.312635:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789065897.312718:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235965696:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 438us (655us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1789065897.312743:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00010000:00010000:1.0:1789065897.314155:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.314176:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.314185:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.314192:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.314198:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.314222:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.314246:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065897.314249:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065897.314256:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.314261:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82ea1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.319782:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.319906:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235965952 00000100:00100000:2.0:1789065897.319922:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235965952 00000100:00100000:2.0:1789065897.320007:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:2.0:1789065897.320019:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+15:10551:x1875971235965952:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789065897.320111:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.320133:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.320143:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.320190:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.320206:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 15 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.320247:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875971257999744:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065897.320362:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b2203c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065897.324747:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875971257999744:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065897.324792:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.326277:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.326391:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235966080 00000100:00100000:2.0:1789065897.326402:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235966080 00010000:00010000:2.0:1789065897.326472:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.326535:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:2.0:1789065897.326599:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+16:2348:x1875971235966080:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065897.326621:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065897.326630:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.326646:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.326676:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82e62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde02 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.326700:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065897.326706:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.326718:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.326749:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.326781:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065897.326976:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+15:2348:x1875971235966080:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 429us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.326984:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00010000:00010000:0.0:1789065897.327153:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327162:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327200:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327208:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327216:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327223:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065897.327228:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327236:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327247:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065897.327250:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789065897.327254:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.327259:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82ea8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.327328:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10551:x1875971235965952:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 7311us (7565us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789065897.327336:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 126 00000100:00100000:0.0:1789065897.340964:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065897.341069:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235966208 00000100:00100000:3.0:1789065897.341083:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235966208 00000100:00100000:3.0:1789065897.341189:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:3.0:1789065897.341204:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235966208:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789065897.341272:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.341299:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 7 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.341310:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065897.341316:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065897.341321:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.341371:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 7 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.341386:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 7 pid: 6880 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065897.341447:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257999872:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065897.342009:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065897.346254:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.346783:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971257999872:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065897.346822:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065897.347041:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235966336 00000100:00100000:3.0:1789065897.347051:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235966336 00010000:00010000:3.0:1789065897.347101:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065897.347147:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1789065897.347158:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235966336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065897.347177:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065897.347209:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.347224:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.347252:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c82e8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde1e expref: 8 pid: 6880 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.347270:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065897.347274:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065897.347281:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.347291:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.347934:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065897.348021:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235966336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 859us (1779us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065897.348034:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00010000:00010000:0.0:1789065897.349867:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.349893:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.349952:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.349962:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.349972:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.349980:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065897.349986:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.349996:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.350047:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.350056:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c82eaf lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.350230:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235966208:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 9022us (9273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065897.350243:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1789065897.354194:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065897.354306:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235966592 00000100:00100000:3.0:1789065897.354321:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235966592 00000100:00100000:3.0:1789065897.354455:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 127 00000100:00100000:3.0:1789065897.354467:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10551:x1875971235966592:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789065897.354790:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.354816:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.354832:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.355135:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.355150:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.355159:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.355211:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.355254:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 15 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065897.355272:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258000000:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065897.355537:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789065897.359747:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065897.359892:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235966720 00000100:00100000:0.0:1789065897.359905:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235966720 00010000:00010000:0.0:1789065897.359961:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065897.360013:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:0.0:1789065897.360026:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:2348:x1875971235966720:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065897.360047:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065897.360056:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.360071:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 16 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.360100:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065897.360127:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.360139:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.360147:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065897.360173:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065897.360348:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+16:2348:x1875971235966720:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 323us (613us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065897.360356:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00010000:00010000:2.0:1789065897.360450:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c82e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde09 expref: 15 pid: 5839 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.360483:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258000000:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065897.360523:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.360534:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.360539:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065897.361061:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1789065897.361252:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1789065897.361322:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1789065897.361424:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875971258000128:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789065897.361687:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065897.361940:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fefd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789065897.363307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258000128 00000100:00100000:3.0:1789065897.363324:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258000128 00000100:00100000:2.0:1789065897.365863:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789065897.365883:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875971258000128:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789065897.366095:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5840:x1875971258000128:12345-0@lo:1000:mdt00_002.0 Request processed in 218us (4407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.366104:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789065897.366199:0:5840:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789065897.366226:0:5840:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07f55df80, transno 4294967310 00000100:00100000:3.0:1789065897.366258:0:5840:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf07f55dc00 x1875971257999232/t4294967311(4294967311) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789065913 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065897.366273:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55c380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875971258000128:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789065897.366991:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:3.0:1789065897.367108:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875971258000256:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789065897.367177:0:5840:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065897.369082:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059000 going to sleep for 11 seconds 00000100:00100000:0.0:1789065897.369146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258000256 00000100:00100000:0.0:1789065897.369158:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258000256 00000100:00100000:0.0:1789065897.369223:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065897.369235:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5840:x1875971258000256:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789065897.369739:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5840:x1875971258000256:12345-0@lo:1000:mdt00_002.0 Request processed in 503us (2560us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1789065897.369748:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789065897.369875:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fbb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5840:1875971258000256:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789065897.369930:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.369943:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.369952:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.369959:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.369965:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.369974:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.369993:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065897.370014:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065897.370021:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370027:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c82ebd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370067:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370073:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370078:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370083:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.370086:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370091:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370098:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065897.370100:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065897.370110:0:5840:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370123:0:5840:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370133:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.370182:0:5840:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065897.370199:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258000384:192.168.204.23@tcp:105: 00000100:00100000:1.0:1789065897.370307:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf060eff900 going to sleep for 11 seconds 00000100:00100000:0.0:1789065897.376363:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.376456:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235966848 00000100:00100000:2.0:1789065897.376483:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235966848 00000100:00100000:2.0:1789065897.376613:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1789065897.376627:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10550:x1875971235966848:12345-192.168.204.23@tcp:49:lfs.0 00000100:00100000:2.0:1789065897.377386:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:10550:x1875971235966848:12345-192.168.204.23@tcp:49:lfs.0 Request processed in 757us (1034us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.377398:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:1.0:1789065897.379523:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258000384:192.168.204.23@tcp:105: 00010000:00010000:1.0:1789065897.379597:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379612:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c82e00 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379670:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379688:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379704:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379719:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379726:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379734:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379767:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.379772:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379781:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379798:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065897.379802:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065897.379807:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379814:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ec4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379827:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379833:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379839:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379845:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.379849:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379856:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379877:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065897.379880:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789065897.379883:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.379890:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c82eb6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789065897.380473:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065897.380481:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065897.380992:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1789065897.381003:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789065897.381162:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:10551:x1875971235966592:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 26689us (26977us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1789065897.381176:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 127 00000020:00080000:1.0:1789065897.381184:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1789065897.383126:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.384007:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235967104 00000100:00100000:1.0:1789065897.384024:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235967104 00000100:00100000:1.0:1789065897.384104:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:1.0:1789065897.384117:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:10550:x1875971235967104:12345-192.168.204.23@tcp:58:lfs.0 00000040:00080000:1.0:1789065897.384808:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789065897.384921:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:10550:x1875971235967104:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 805us (1808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065897.384931:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 128 00000100:00100000:2.0:1789065897.393966:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065897.394196:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235967360 00000100:00100000:3.0:1789065897.394212:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235967360 00000100:00100000:3.0:1789065897.394290:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:3.0:1789065897.394304:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+18:10551:x1875971235967360:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789065897.395263:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789065897.395392:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1789065897.395460:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.395495:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.395523:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.395535:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.395543:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.395600:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065897.398677:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789065897.399123:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+20:10551:x1875971235967360:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 4813us (5162us total) trans 4294967409 rc 0/0 00000100:00100000:0.0:1789065897.399137:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000020:00080000:0.0:1789065897.399145:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1789065897.402538:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789065897.402580:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.402595:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065897.402600:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.402643:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.402668:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:1.0:1789065897.402671:0:5826:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1789065897.402679:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.402686:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c82ecb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.402718:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065897.402721:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065897.402723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065897.433696:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065897.433835:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235967488 00000100:00100000:1.0:1789065897.433848:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235967488 00000100:00100000:1.0:1789065897.433923:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 129 00000100:00100000:1.0:1789065897.433938:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+20:10553:x1875971235967488:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789065897.433981:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065897.434008:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ed2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde25 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434098:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434116:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434130:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434172:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434181:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434188:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434494:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434521:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434532:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434652:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.434670:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 21 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065897.434688:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258000512:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065897.434847:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050e53a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789065897.438225:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258000512:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789065897.438279:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.440078:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065897.440201:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235967744 00000100:00100000:0.0:1789065897.440214:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235967744 00000100:00100000:0.0:1789065897.440295:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1789065897.440323:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+22:5592:x1875971235967744:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789065897.440732:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+23:5592:x1875971235967744:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 409us (666us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789065897.440742:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:3.0:1789065897.443846:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065897.444041:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235967872 00000100:00100000:2.0:1789065897.444056:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235967872 00010000:00010000:2.0:1789065897.444112:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 23 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065897.444185:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:2.0:1789065897.444197:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+23:2347:x1875971235967872:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065897.444221:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065897.444230:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 23 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.444247:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 23 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.444276:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82df2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdde6 expref: 23 pid: 5840 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.444298:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065897.444305:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.444318:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.444328:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065897.444486:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065897.444638:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+22:2347:x1875971235967872:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 442us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065897.444647:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00010000:00010000:1.0:1789065897.446286:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.446305:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065897.446372:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789065897.446378:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065897.446534:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447354:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447372:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447380:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447388:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447395:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.447399:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447407:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447683:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065897.447712:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065897.447720:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447730:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7a00/0x7555615576c82ed9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447752:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447759:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447846:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447852:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065897.447856:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447863:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447873:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9cf06a8c0c00) 00010000:00010000:1.0:1789065897.447876:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065897.447880:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447886:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82ee0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447950:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82ed2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde25 expref: 22 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447982:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde25 expref: 21 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065897.447990:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065897.447993:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065897.447996:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7800, rc 0) 00000100:00100000:1.0:1789065897.448184:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10553:x1875971235967488:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 14247us (14502us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065897.448195:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 129 00010000:00010000:3.0:1789065897.960282:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789065898.406906:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065898.406932:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065898.406984:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789065898.406992:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065898.407180:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258000640:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789065898.407454:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf041370840 going to sleep for 11 seconds 00000100:00100000:1.0:1789065898.413647:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258000640:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789065898.418265:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065898.418776:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235968000 00000100:00100000:3.0:1789065898.418804:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235968000 00000100:00100000:3.0:1789065898.418901:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00100000:3.0:1789065898.418914:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10564:x1875971235968000:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789065898.418971:0:5838:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789065898.419126:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec89c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10564:x1875971235968000:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 213us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065898.419134:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 130 00000100:00080000:0.0:1789065898.419522:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1789065898.433503:0:12051:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789065898.433519:0:12051:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789065898.433608:0:12051:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789065898.433615:0:12051:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065898.435620:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065898.436102:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235968256 00000100:00100000:1.0:1789065898.436117:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235968256 00000100:00100000:1.0:1789065898.436206:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 131 00000100:00100000:1.0:1789065898.436220:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+21:10564:x1875971235968256:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065898.436250:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065898.436280:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6400/0x7555615576c82eee lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde2c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065898.436418:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6600/0x7555615576c82ef5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065898.436437:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6600/0x7555615576c82ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065898.436495:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6600/0x7555615576c82ef5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065898.436510:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789065898.436707:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6400/0x7555615576c82eee lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde2c expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065898.436729:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6600/0x7555615576c82ef5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde2c expref: 23 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065898.436737:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065898.436740:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065898.436744:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6600, rc 0) 00000100:00100000:1.0:1789065898.436841:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+23:10564:x1875971235968256:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 624us (1236us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1789065898.436849:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 131 00000100:00100000:0.0:1789065898.475805:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065898.476750:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235968384 00000100:00100000:3.0:1789065898.476766:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235968384 00000100:00100000:0.0:1789065898.476906:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065898.477001:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235968640 00000100:00100000:2.0:1789065898.477006:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235968640 00000100:00100000:2.0:1789065898.477061:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 132 00000100:00100000:2.0:1789065898.477073:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:10564:x1875971235968640:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789065898.477180:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477202:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477218:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477526:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477535:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477542:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477573:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065898.477579:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477606:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477621:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065898.477624:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789065898.477631:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065898.477639:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f03 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065898.477839:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+25:10564:x1875971235968640:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 765us (933us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1789065898.477849:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 132 00000040:00080000:2.0:1789065898.478001:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065898.478007:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065898.478483:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789065898.478509:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789065898.490522:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1789065898.490851:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+24:2350:x1875971235968384:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065898.490882:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065898.490922:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6600/0x7555615576c82ef5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde2c expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065898.490941:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:3.0:1789065898.490948:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065898.491023:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+23:2350:x1875971235968384:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 186us (15232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065898.491032:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1789065898.524278:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065898.524775:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235968896 00000100:00100000:3.0:1789065898.524791:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235968896 00000100:00100000:3.0:1789065898.524871:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1789065898.524884:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+23:10564:x1875971235968896:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789065898.525217:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:10564:x1875971235968896:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 334us (956us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789065898.525226:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00010000:00010000:0.0:1789065898.983430:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065900.007402:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065900.198144:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258000768:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065900.198283:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065900.198425:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258000768 00000100:00100000:1.0:1789065900.198438:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258000768 00000100:00080000:2.0:1789065900.198568:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789065900.198677:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789065900.198694:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258000768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789065900.198813:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065900.198889:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258000768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 199us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065900.198897:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789065900.198948:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258000768:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789065900.500989:0:12104:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789065900.501002:0:12104:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789065900.501057:0:12104:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1789065900.501064:0:12104:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789065900.693885:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065900.693971:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969152 00000100:00100000:2.0:1789065900.693986:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969152 00000100:00100000:2.0:1789065900.694083:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00100000:2.0:1789065900.694098:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+24:10585:x1875971235969152:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065900.694134:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065900.694163:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82f0a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde33 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065900.694318:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82f11 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065900.694337:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065900.694353:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82f11 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065900.694367:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1789065900.694591:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c82f0a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde33 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065900.694612:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82f11 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde33 expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065900.694623:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:2.0:1789065900.694627:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789065900.694632:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d200, rc 0) 00000100:00100000:2.0:1789065900.694724:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+26:10585:x1875971235969152:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 629us (854us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1789065900.694733:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 133 00000100:00080000:3.0:1789065900.694832:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065900.704308:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065900.704405:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969280 00000100:00100000:0.0:1789065900.704418:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969280 00000100:00100000:0.0:1789065900.704510:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:0.0:1789065900.704523:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+26:10585:x1875971235969280:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1789065900.704664:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704689:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704704:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704741:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704772:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704780:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704787:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065900.704793:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704801:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704817:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:0.0:1789065900.704820:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789065900.704826:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065900.704833:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82f1f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065900.704929:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+26:10585:x1875971235969280:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 408us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065900.704938:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 134 00000100:00100000:1.0:1789065900.807482:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065900.807588:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969408 00000100:00100000:3.0:1789065900.807601:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969408 00000100:00100000:3.0:1789065900.807755:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00080000:0.0:1789065900.807755:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065900.807768:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235969408:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1789065900.807793:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065900.807823:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c82f26 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde3a expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065900.807871:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2faa8, atime: 0x6aa2faa7, ctime: 0x6aa2faa8, blocks: 0xb 00010000:00010000:3.0:1789065900.807896:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1789065900.807901:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065900.807911:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c82f26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde3a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065900.807933:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c82f26 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde3a expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065900.807949:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654e00, rc 0) 00000100:00100000:3.0:1789065900.808027:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235969408:12345-192.168.204.23@tcp:101:cat.0 Request processed in 263us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065900.808035:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:3.0:1789065900.812799:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065900.812881:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969536 00000100:00100000:0.0:1789065900.812896:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969536 00002000:00100000:0.0:1789065900.812964:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9cf050cd1880 x1875971235969536/t0(0) o3->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:546/0 lens 488/0 e 0 to 0 dl 1789065911 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065900.812977:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf050cd1880 with x1875971235969536 ext(0->4095) 00002000:00010000:0.0:1789065900.813006:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf050cd1880 00000100:00100000:0.0:1789065900.813049:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1789065900.813061:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235969536:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1789065900.813383:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235969536:12345-192.168.204.23@tcp:3:cat.0 Request processed in 323us (614us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789065900.813397:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00002000:00100000:0.0:1789065900.813405:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff9cf050cd1880 x1875971235969536/t0(0) o3->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:546/0 lens 488/4536 e 0 to 0 dl 1789065911 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065900.814054:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf050cd1880 with x1875971235969536 ext(0->4095) 00002000:00010000:0.0:1789065900.814060:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf050cd1880 00010000:00010000:3.0:1789065901.030056:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065901.222537:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258001280:0@lo:400:kworker.0 00000100:00100000:3.0:1789065901.222653:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065901.222742:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789065901.222749:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789065901.222779:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065901.222817:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258001408:0@lo:400:kworker.0 00000100:00100000:3.0:1789065901.223045:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065901.223099:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258000896 00000100:00100000:3.0:1789065901.223109:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258000896 00000100:00100000:3.0:1789065901.223173:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789065901.223184:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001280 00000100:00100000:3.0:1789065901.223187:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258000896:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065901.223189:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001280 00000100:00100000:2.0:1789065901.223225:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789065901.223233:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258001280:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1789065901.223241:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065901.223294:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258001280:12345-0@lo:400:kworker.0 Request processed in 62us (641us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065901.223308:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789065901.223393:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258001280:0@lo:400:kworker.0 00000100:00100000:3.0:1789065901.223773:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258000896:12345-0@lo:13:osp-pre-1-0.0 Request processed in 589us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065901.223781:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789065901.223879:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258001152:0@lo:400:kworker.0 00000100:00100000:0.0:1789065901.223915:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065901.223947:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258001664:0@lo:400:kworker.0 00000100:00100000:0.0:1789065901.223971:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065901.223995:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789065901.224001:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971258001024:0@lo:400:kworker.0 00000100:00100000:0.0:1789065901.224031:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065901.224056:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258001536:0@lo:400:kworker.0 00000100:00100000:0.0:1789065901.224078:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065901.224119:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001408 00000100:00100000:0.0:1789065901.224125:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001408 00000100:00100000:0.0:1789065901.224160:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001664 00000100:00100000:0.0:1789065901.224163:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001664 00000100:00100000:0.0:1789065901.224182:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789065901.224190:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258001408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065901.224220:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258000896:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065901.224236:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258001408:12345-0@lo:400:kworker.0 Request processed in 47us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065901.224240:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258001408:0@lo:400:kworker.0 00000100:00100000:0.0:1789065901.224243:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789065901.224255:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789065901.224261:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1875971258001664:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789065901.224275:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789065901.224281:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065901.224290:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3298:x1875971258001664:12345-0@lo:400:kworker.0 Request processed in 29us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065901.224296:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789065901.224300:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001024 00000100:00100000:2.0:1789065901.224303:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001024 00000100:00100000:0.0:1789065901.224322:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258001664:0@lo:400:kworker.0 00000100:00100000:2.0:1789065901.224327:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1789065901.224333:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971258001024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065901.224463:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971258001024:12345-0@lo:400:kworker.0 Request processed in 129us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065901.224470:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:0.0:1789065901.224685:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971258001024:0@lo:400:kworker.0 00000100:00100000:3.0:1789065901.224754:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001536 00000100:00100000:2.0:1789065901.224754:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001152 00000100:00100000:3.0:1789065901.224759:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001536 00000100:00100000:2.0:1789065901.224759:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001152 00000100:00100000:2.0:1789065901.224791:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1789065901.224796:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789065901.224798:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258001152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065901.224801:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258001536:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789065901.224861:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065901.224976:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258001536:12345-0@lo:400:kworker.0 Request processed in 173us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065901.224982:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1789065901.233568:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258001152:12345-0@lo:400:kworker.0 Request processed in 8742us (9624us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065901.233589:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1789065901.234013:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258001536:0@lo:400:kworker.0 00000100:00100000:0.0:1789065901.234046:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258001152:0@lo:400:kworker.0 00000001:00080000:0.0:1789065901.290761:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1789065901.290791:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:0.0:1789065901.478368:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065901.478422:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065901.478472:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065901.478504:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065901.478527:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065901.478585:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970176 00000100:00100000:0.0:1789065901.478597:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970176 00000100:00100000:0.0:1789065901.478672:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969792 00000100:00100000:0.0:1789065901.478675:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969792 00000100:00100000:0.0:1789065901.478702:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:0.0:1789065901.478730:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971235970176:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065901.478823:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971235970176:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 95us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065901.478830:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:0.0:1789065901.478850:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1789065901.478856:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+26:2349:x1875971235969792:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065901.478884:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+26:2349:x1875971235969792:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065901.478891:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:0.0:1789065901.478915:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969920 00000100:00100000:0.0:1789065901.478918:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969920 00000100:00100000:0.0:1789065901.478944:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970048 00000100:00100000:0.0:1789065901.478947:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970048 00000100:00100000:0.0:1789065901.478970:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:0.0:1789065901.478977:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971235969920:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065901.479004:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971235969920:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065901.479011:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:0.0:1789065901.479022:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:0.0:1789065901.479029:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235970048:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065901.479051:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235970048:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 23us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065901.479057:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00080000:0.0:1789065901.479073:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789065901.479084:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065901.479472:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235969664 00000100:00100000:3.0:1789065901.479481:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235969664 00000100:00100000:3.0:1789065901.479525:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 301 00000100:00100000:3.0:1789065901.479534:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235969664:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065901.479603:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0509b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971235969664:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 70us (1260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065901.479609:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 301 00010000:00010000:2.0:1789065902.055058:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789065902.320867:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967410 is committed 00000001:00080000:0.0:1789065902.320887:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967411 is committed 00000001:00080000:0.0:1789065902.320902:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:0.0:1789065902.320918:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:0.0:1789065902.320949:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf06a7e7c00 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:0.0:1789065902.320955:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07f162500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf06a7e73c0 00000020:00080000:0.0:1789065902.320960:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07f162400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf07f4b6800 00000020:00080000:2.0:1789065902.321012:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789065902.321278:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000040:00080000:3.0:1789065902.567875:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065902.567887:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789065902.567943:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789065902.567957:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1789065902.807907:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1789065902.807926:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00010000:00010000:2.0:1789065903.077845:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065904.101909:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065905.141800:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065905.318968:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789065905.318999:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258001792:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065905.319092:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065905.319188:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001792 00000100:00100000:2.0:1789065905.319197:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001792 00000100:00100000:2.0:1789065905.319259:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1789065905.319282:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258001792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065905.319333:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065905.319401:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258001792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065905.319408:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:2.0:1789065905.319433:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065905.319465:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:2.0:1789065905.319471:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07f55dc00, transno 4294967311 00000004:00080000:2.0:1789065905.319481:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:2.0:1789065905.319526:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258001792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065905.656060:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065905.656135:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970304 00000100:00100000:1.0:1789065905.656157:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970304 00000100:00100000:1.0:1789065905.656243:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00100000:1.0:1789065905.656255:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10238:x1875971235970304:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789065905.656406:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10238:x1875971235970304:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 Request processed in 153us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065905.656414:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 135 00000100:00080000:0.0:1789065905.657086:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065905.666950:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065905.667105:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970560 00000100:00100000:0.0:1789065905.667120:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970560 00000100:00100000:0.0:1789065905.667227:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:0.0:1789065905.667242:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+13:10238:x1875971235970560:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789065905.668033:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:10238:x1875971235970560:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 788us (1096us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1789065905.668045:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00010000:00010000:2.0:1789065906.157050:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065906.341862:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065906.341895:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258001920:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065906.341998:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065906.342054:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258001920 00000100:00100000:2.0:1789065906.342067:0:6689:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258001920 00000100:00100000:2.0:1789065906.342147:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789065906.342161:0:6689:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258001920:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789065906.342179:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:2.0:1789065906.342381:0:6689:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065906.342462:0:6689:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258001920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 304us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065906.342470:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789065906.342518:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1789065906.342527:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000100:00100000:2.0:1789065906.342581:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000004:00080000:1.0:1789065906.342585:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07b0b0700, transno 4294967304 00000100:00100000:2.0:1789065906.342593:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971258002304:0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.342606:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e61880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258001920:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065906.342651:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065906.342705:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258002432:0@lo:400:kworker.0 00000100:00100000:2.0:1789065906.342732:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065906.342777:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258002048:0@lo:400:kworker.0 00000100:00100000:2.0:1789065906.342796:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258002432 00000100:00100000:2.0:1789065906.342801:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258002432 00000100:00100000:0.0:1789065906.342816:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065906.342843:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258002560:0@lo:400:kworker.0 00000100:00100000:0.0:1789065906.342866:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065906.342887:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065906.342893:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258002176:0@lo:400:kworker.0 00000100:00100000:0.0:1789065906.342933:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065906.343129:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789065906.343348:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258002432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343519:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258002304 00000100:00100000:1.0:1789065906.343526:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258002304 00000100:00100000:1.0:1789065906.343582:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258002560 00000100:00100000:1.0:1789065906.343586:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258002560 00000100:00100000:1.0:1789065906.343601:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258002176 00000100:00100000:1.0:1789065906.343604:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258002176 00000100:00100000:1.0:1789065906.343617:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789065906.343636:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971258002304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343684:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971258002304:12345-0@lo:400:kworker.0 Request processed in 60us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065906.343690:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789065906.343704:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789065906.343710:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258002560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343751:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258002560:12345-0@lo:400:kworker.0 Request processed in 41us (884us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065906.343757:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1789065906.343770:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789065906.343775:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258002176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343800:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258002176:12345-0@lo:400:kworker.0 Request processed in 25us (867us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065906.343805:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1789065906.343823:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258002048 00000100:00100000:1.0:1789065906.343827:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258002048 00000100:00100000:1.0:1789065906.343853:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789065906.343859:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971258002048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343890:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971258002048:12345-0@lo:400:kworker.0 Request processed in 31us (1073us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065906.343896:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1789065906.343945:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971258002304:0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343977:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258002176:0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343986:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258002048:0@lo:400:kworker.0 00000100:00100000:1.0:1789065906.343996:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258002560:0@lo:400:kworker.0 00000100:00080000:1.0:1789065906.344025:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065906.344047:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258002432:12345-0@lo:400:kworker.0 Request processed in 909us (1313us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065906.344218:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258002432:0@lo:400:kworker.0 00000100:00100000:2.0:1789065906.353193:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1789065906.606907:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065906.606988:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065906.607030:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065906.607054:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065906.607085:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065906.607275:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970944 00000100:00100000:3.0:1789065906.607289:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970944 00000100:00100000:0.0:1789065906.607407:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235971200 00000100:00100000:0.0:1789065906.607412:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235971200 00000100:00100000:2.0:1789065906.607741:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970688 00000100:00100000:2.0:1789065906.607747:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970688 00000100:00100000:2.0:1789065906.607788:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 303 00000100:00100000:2.0:1789065906.607801:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235970688:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065906.607899:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235970688:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 100us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065906.607907:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 303 00000100:00080000:2.0:1789065906.608104:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789065906.608127:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065906.612345:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235971072 00000100:00100000:3.0:1789065906.612507:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235971072 00000100:00100000:3.0:1789065906.612618:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:3.0:1789065906.612632:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235970944:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065906.612758:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2350:x1875971235970944:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 128us (5767us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065906.612767:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:3.0:1789065906.612789:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:3.0:1789065906.612797:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235971072:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065906.612825:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971235971072:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 30us (5740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065906.612831:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:3.0:1789065906.614967:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235970816 00000100:00100000:3.0:1789065906.614994:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235970816 00000100:00100000:3.0:1789065906.615082:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:3.0:1789065906.615094:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235971200:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065906.617843:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235971200:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 2731us (10791us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065906.617862:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:3.0:1789065906.617917:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:3.0:1789065906.617954:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2350:x1875971235970816:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065906.618001:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2350:x1875971235970816:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 53us (10945us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065906.618007:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00080000:3.0:1789065906.624697:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789065907.175450:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789065907.459906:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1789065907.459929:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1789065907.460005:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789065907.460019:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:02000400:3.0:1789065907.734301:0:12306:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 14:45:05 (1789065905) 00010000:00010000:2.0:1789065908.198492:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065909.061200:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065909.061352:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235971456 00000100:00100000:1.0:1789065909.061362:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235971456 00000100:00100000:1.0:1789065909.061529:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 136 00000100:00100000:1.0:1789065909.061541:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:11296:x1875971235971456:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065909.061609:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065909.061635:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82f2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde41 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.061797:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.061812:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.061825:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.061841:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.061849:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.061856:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789065909.062013:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789065909.062106:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82f42 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.062116:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.062135:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82f42 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065909.062146:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789065909.064394:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064410:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064498:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064506:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065909.064510:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064518:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064532:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf043eb1500) 00010000:00010000:1.0:1789065909.064535:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065909.064540:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064562:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c82f34 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064577:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064584:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064602:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064608:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065909.064610:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064617:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064624:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf06a8c0300) 00010000:00010000:1.0:1789065909.064627:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065909.064630:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.064635:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7c00/0x7555615576c82f3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.065090:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c82f2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde41 expref: 16 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.065107:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82f42 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde41 expref: 15 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065909.065114:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:1.0:1789065909.065116:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065909.065118:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6800, rc 0) 00000100:00100000:1.0:1789065909.065198:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+15:11296:x1875971235971456:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 3658us (4019us total) trans 4294967416 rc 0/0 00000100:00100000:1.0:1789065909.065216:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 136 00000100:00100000:3.0:1789065909.072027:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065909.076755:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065909.077007:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235971712 00000100:00100000:3.0:1789065909.077022:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235971712 00000100:00100000:3.0:1789065909.077120:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1789065909.077133:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+15:2348:x1875971235971712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065909.077154:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065909.077189:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c82f42 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde41 expref: 15 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065909.077214:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:3.0:1789065909.077221:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065909.077442:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c198c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2348:x1875971235971712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 310us (700us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065909.077452:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1789065909.078074:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235971584 00000100:00100000:0.0:1789065909.078092:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235971584 00000100:00100000:0.0:1789065909.078229:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 137 00000100:00100000:0.0:1789065909.078241:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:11296:x1875971235971584:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789065909.078381:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+14:11296:x1875971235971584:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 Request processed in 141us (6371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065909.078389:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 137 00010000:00010000:2.0:1789065909.221850:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789065909.734531:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789065909.734542:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789065909.735039:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1789065909.735049:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1789065910.245892:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065910.437849:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065910.437874:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258002688:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065910.437946:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065910.438068:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258002688 00000100:00100000:2.0:1789065910.438076:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258002688 00000100:00100000:2.0:1789065910.438145:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789065910.438155:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258002688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065910.438208:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065910.438280:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258002688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065910.438296:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789065910.438501:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258002688:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789065910.438606:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065911.130694:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.131123:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235971840 00000100:00100000:2.0:1789065911.131256:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235971840 00000100:00100000:2.0:1789065911.131333:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00100000:2.0:1789065911.131345:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:11338:x1875971235971840:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065911.131364:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.131384:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde48 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131448:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131461:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131474:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131488:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131496:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131502:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131743:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131752:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131759:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131765:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.131770:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131777:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131789:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065911.131792:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.131797:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131803:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82f57 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131815:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131821:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131827:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131840:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.131844:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131849:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131857:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cf042e0fe00) 00010000:00010000:2.0:1789065911.131859:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.131862:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131867:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f5e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131897:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82f50 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde48 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131907:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789065911.131909:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.131912:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde48 expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.131920:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c600, rc 0) 00000100:00100000:2.0:1789065911.131982:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:11338:x1875971235971840:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 640us (1300us total) trans 0 rc 301/301 00000100:00100000:2.0:1789065911.131990:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 138 00000100:00080000:2.0:1789065911.132014:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065911.144513:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.144703:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972096 00000100:00100000:0.0:1789065911.144713:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972096 00000100:00100000:0.0:1789065911.144772:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 139 00000100:00100000:0.0:1789065911.144782:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+14:11338:x1875971235972096:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:0.0:1789065911.144836:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065911.144864:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c828dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc88 expref: 14 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.144884:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0ff00) 00010000:00010000:0.0:1789065911.144907:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065911.145121:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.145147:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.145166:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.145180:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.145187:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.145194:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065911.147866:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789065911.147887:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.147897:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.147905:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.147911:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065911.147916:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.147936:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.147952:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065911.147955:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065911.147960:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.147966:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f65 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065911.147987:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000cd684654 reply state 00000000907670f6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065911.147996:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065911.148172:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+15:11338:x1875971235972096:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 3388us (3663us total) trans 4294967417 rc 0/0 00000100:00100000:0.0:1789065911.148181:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 139 00010000:00010000:0.0:1789065911.159075:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.159093:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.159102:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.159108:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065911.159113:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.159142:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.159160:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065911.159163:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065911.159168:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.159174:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f6c lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065911.236021:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.236274:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972224 00000100:00100000:2.0:1789065911.236285:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972224 00000100:00100000:2.0:1789065911.236358:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 140 00000100:00100000:2.0:1789065911.236370:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+14:11346:x1875971235972224:12345-192.168.204.23@tcp:101:lctl.0 00010000:00010000:2.0:1789065911.236405:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.236433:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82f73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde4f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.236504:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f7a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.236517:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.236529:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065911.236600:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789065911.236605:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065911.236628:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f7a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.236655:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c82f73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde4f expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.236677:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f7a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde4f expref: 15 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.236686:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789065911.236689:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065911.236709:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c400, rc 0) 00000100:00100000:0.0:1789065911.236969:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+15:11346:x1875971235972224:12345-192.168.204.23@tcp:101:lctl.0 Request processed in 599us (956us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065911.236977:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 140 00010000:00010000:2.0:1789065911.271573:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065911.293079:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.293194:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972352 00000100:00100000:0.0:1789065911.293204:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972352 00000100:00100000:0.0:1789065911.293283:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 141 00000100:00100000:0.0:1789065911.293294:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+15:11352:x1875971235972352:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1789065911.293315:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065911.293338:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde56 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293402:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293415:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293427:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293454:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293461:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293467:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293600:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82f96 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293608:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293615:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065911.293641:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789065911.293644:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065911.293662:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82f96 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293673:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293679:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293685:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293701:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065911.293705:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293713:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293725:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:0.0:1789065911.293728:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065911.293733:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293739:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82f88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293754:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293759:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293777:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293783:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065911.293785:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293790:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293807:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065911.293809:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065911.293812:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293818:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82f8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293847:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c82f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde56 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293860:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82f96 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde56 expref: 16 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.293867:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065911.293869:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789065911.293871:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049200, rc 0) 00000100:00100000:0.0:1789065911.293931:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+16:11352:x1875971235972352:12345-192.168.204.23@tcp:101:bash.0 Request processed in 639us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065911.293940:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 141 00000100:00100000:2.0:1789065911.297986:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065911.298078:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972608 00000100:00100000:3.0:1789065911.298089:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972608 00000100:00100000:3.0:1789065911.298142:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 142 00000100:00100000:3.0:1789065911.298163:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+16:11352:x1875971235972608:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065911.298183:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065911.298204:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c82f9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde5d expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.298346:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.298361:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.298373:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.298430:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.298438:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.298445:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789065911.299006:0:8255:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:3.0:1789065911.299179:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299199:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299208:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299254:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299262:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299269:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299276:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065911.299280:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299288:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299299:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065911.299303:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065911.299307:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299314:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c82fa4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789065911.299327:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000fd540ce9 reply state 000000008e2804bd transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065911.299343:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789065911.299371:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c82f9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 19 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299386:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.299393:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065911.299395:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065911.299398:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655c00, rc 0) 00000100:00100000:3.0:1789065911.299475:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11352:x1875971235972608:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1324us (1497us total) trans 4294967418 rc 0/0 00000100:00100000:3.0:1789065911.299484:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 142 00010000:00010000:1.0:1789065911.301749:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.301767:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.301775:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.301780:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065911.301785:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.301792:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.301807:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043e52400) 00010000:00010000:1.0:1789065911.301811:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065911.301815:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.301822:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c82fab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065911.306141:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065911.306255:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972736 00000100:00100000:3.0:1789065911.306268:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972736 00000100:00100000:3.0:1789065911.306353:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1789065911.306366:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2347:x1875971235972736:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065911.306387:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065911.306413:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde64 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065911.306444:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789065911.306467:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=370s v=(0 0) 00010000:00010000:3.0:1789065911.306471:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065911.306481:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.306525:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 6 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.306540:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655400, rc 0) 00000100:00100000:3.0:1789065911.306633:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235972736:12345-192.168.204.23@tcp:101:bash.0 Request processed in 270us (503us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065911.306641:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00080000:2.0:1789065911.306865:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065911.310438:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.310583:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972864 00000100:00100000:0.0:1789065911.310594:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972864 00000100:00100000:0.0:1789065911.310656:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:0.0:1789065911.310667:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+6:11352:x1875971235972864:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1789065911.310686:0:6880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065911.310703:0:6880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde6b expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.310752:0:6880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.310762:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065911.310777:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065911.310783:0:6880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 7 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.310815:0:6880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.310830:0:6880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065911.310844:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0817b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6880:1875971258002816:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065911.310934:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73900 going to sleep for 11 seconds 00000100:00100000:0.0:1789065911.316228:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0817b8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:6880:1875971258002816:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065911.316274:0:6880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 7 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.316298:0:6880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b048e00, rc 0) 00000100:00100000:0.0:1789065911.316360:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+7:11352:x1875971235972864:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5694us (5931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065911.316370:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:1.0:1789065911.319208:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065911.319355:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235972992 00000100:00100000:3.0:1789065911.319366:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235972992 00010000:00010000:3.0:1789065911.319407:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065911.319449:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:3.0:1789065911.319459:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235972992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065911.319474:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065911.319501:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.319517:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.319540:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c82fc0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde64 expref: 7 pid: 6685 timeout: 470 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.319598:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065911.319602:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065911.319611:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 6 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.319622:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 6 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.319664:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 6 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065911.319680:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae67b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1875971258002944:192.168.204.23@tcp:105: 00000100:00100000:3.0:1789065911.319784:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051a65240 going to sleep for 11 seconds 00000100:00100000:3.0:1789065911.323640:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.323759:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae67b80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1875971258002944:192.168.204.23@tcp:105: 00010000:00010000:0.0:1789065911.323799:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065911.323864:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235972992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 4405us (4665us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065911.323874:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1789065911.324459:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235973248 00000100:00100000:1.0:1789065911.324469:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235973248 00000100:00100000:1.0:1789065911.324527:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:1.0:1789065911.324538:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11352:x1875971235973248:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1789065911.325069:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11352:x1875971235973248:12345-192.168.204.23@tcp:35:bash.0 Request processed in 532us (1439us total) trans 4294967419 rc 0/0 00000100:00100000:1.0:1789065911.325077:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:3.0:1789065911.443640:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.444089:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235973504 00000100:00100000:0.0:1789065911.444103:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235973504 00000100:00100000:0.0:1789065911.444423:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00100000:0.0:1789065911.444437:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11362:x1875971235973504:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065911.444464:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065911.444487:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde72 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065911.444616:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:0.0:1789065911.444763:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82fce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde72 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.444780:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:0.0:1789065911.444783:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789065911.444788:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049000/0x7555615576c82fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde72 expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.444804:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049000, rc 0) 00000100:00100000:0.0:1789065911.444892:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec88380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11362:x1875971235973504:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 458us (1262us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1789065911.444899:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 143 00000100:00100000:2.0:1789065911.448971:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065911.449690:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235973760 00000100:00100000:1.0:1789065911.449701:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235973760 00000100:00100000:1.0:1789065911.449789:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1789065911.449800:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11362:x1875971235973760:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065911.450340:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+21:11362:x1875971235973760:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 539us (1375us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789065911.450349:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:1.0:1789065911.462706:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258003072:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.462798:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.462857:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258003584:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.462893:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.462924:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789065911.462930:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258003200:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.462953:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.462970:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258003712:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.462994:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.463037:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258003456:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463061:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.463076:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789065911.463081:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258003328:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463101:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.463132:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003072 00000100:00100000:1.0:1789065911.463140:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003072 00000100:00100000:1.0:1789065911.463186:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789065911.463195:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971258003072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463267:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971258003072:12345-0@lo:400:kworker.0 Request processed in 73us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.463274:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1789065911.463446:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258003072:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463478:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003712 00000100:00100000:1.0:1789065911.463481:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003712 00000100:00100000:1.0:1789065911.463519:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003456 00000100:00100000:1.0:1789065911.463522:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003456 00000100:00100000:1.0:1789065911.463540:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789065911.463545:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258003712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463608:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258003712:12345-0@lo:400:kworker.0 Request processed in 62us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.463614:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789065911.463624:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789065911.463629:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258003456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463660:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258003456:12345-0@lo:400:kworker.0 Request processed in 31us (598us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.463679:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1789065911.463699:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789065911.463717:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258003456:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463738:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258003712:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463754:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003584 00000100:00100000:1.0:1789065911.463757:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003584 00000100:00100000:1.0:1789065911.463783:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003200 00000100:00100000:1.0:1789065911.463786:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003200 00000100:00100000:1.0:1789065911.463796:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003328 00000100:00100000:1.0:1789065911.463799:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003328 00000100:00100000:1.0:1789065911.463812:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789065911.463818:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971258003584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463852:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971258003584:12345-0@lo:400:kworker.0 Request processed in 34us (958us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.463858:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1789065911.463869:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789065911.463874:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258003200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463900:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058214700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258003200:12345-0@lo:400:kworker.0 Request processed in 26us (946us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.463906:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1789065911.463916:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1789065911.463922:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258003328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.463950:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258003328:12345-0@lo:400:kworker.0 Request processed in 29us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.463956:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00080000:1.0:1789065911.463977:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065911.463994:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258003328:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.464013:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258003200:0@lo:400:kworker.0 00000100:00100000:1.0:1789065911.464020:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258003584:0@lo:400:kworker.0 00000100:00100000:0.0:1789065911.464430:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258003840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065911.464489:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065911.464602:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258003840 00000100:00100000:2.0:1789065911.464607:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258003840 00000100:00100000:2.0:1789065911.464643:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789065911.464651:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258003840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065911.464679:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065911.464718:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258003840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.464723:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789065911.464831:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258003840:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065911.566328:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.566515:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235973888 00000100:00100000:2.0:1789065911.566526:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235973888 00000100:00100000:2.0:1789065911.566630:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00100000:2.0:1789065911.566643:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+21:11368:x1875971235973888:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065911.566669:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.566693:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82fdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde79 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.566768:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c82fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.566784:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c82fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.566797:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c82fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065911.566850:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789065911.566854:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065911.566872:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c82fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.566899:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde79 expref: 23 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.566919:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c82fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde79 expref: 22 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.566928:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065911.566932:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065911.566936:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c200, rc 0) 00000100:00100000:2.0:1789065911.566996:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+22:11368:x1875971235973888:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 357us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.567010:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 144 00000100:00100000:3.0:1789065911.574184:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.575225:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235974144 00000100:00100000:0.0:1789065911.575250:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235974144 00000100:00100000:0.0:1789065911.575323:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 145 00000100:00100000:0.0:1789065911.575335:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+22:11368:x1875971235974144:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065911.575358:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065911.575381:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82fea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde80 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.575487:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82ff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.575513:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.575526:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065911.575539:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789065911.575724:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c82fea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde80 expref: 25 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.575744:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde80 expref: 24 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.575753:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:0.0:1789065911.575756:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789065911.575774:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049400, rc 0) 00000100:00100000:0.0:1789065911.576038:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fd23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11368:x1875971235974144:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 703us (1862us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789065911.576047:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 145 00000100:00100000:0.0:1789065911.593387:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.593460:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235974400 00000100:00100000:2.0:1789065911.593472:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235974400 00000100:00100000:2.0:1789065911.593542:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 146 00000100:00100000:2.0:1789065911.593586:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11368:x1875971235974400:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065911.593618:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.593638:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde87 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.593736:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.593774:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.593787:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065911.593802:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789065911.593928:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c82fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde87 expref: 27 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.593949:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde87 expref: 26 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.593957:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065911.593960:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789065911.593964:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065911.594019:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11368:x1875971235974400:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 436us (643us total) trans 4294967423 rc 0/0 00000100:00100000:2.0:1789065911.594026:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 146 00000100:00100000:3.0:1789065911.594459:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.594627:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235974528 00000100:00100000:2.0:1789065911.594634:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235974528 00000100:00100000:2.0:1789065911.594682:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1789065911.594691:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+26:2347:x1875971235974528:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065911.594703:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065911.594721:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c82ff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde80 expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.594750:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065911.594754:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065911.594791:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+25:2347:x1875971235974528:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 101us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.594798:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1789065911.599521:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065911.599627:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235974656 00000100:00100000:1.0:1789065911.599637:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235974656 00000100:00100000:1.0:1789065911.599695:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:1.0:1789065911.599706:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235974656:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:1.0:1789065911.599763:0:6685:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.599784:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 6 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.599793:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065911.599797:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789065911.599802:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.599837:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 6 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.599852:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 6 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065911.599887:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875971258003968:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065911.599977:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f0599c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065911.604391:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065911.604538:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235974784 00000100:00100000:3.0:1789065911.604584:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235974784 00000100:00100000:1.0:1789065911.604618:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e73480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875971258003968:192.168.204.23@tcp:104: 00002000:00100000:3.0:1789065911.604633:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cf0817b9500 x1875971235974784/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:557/0 lens 504/0 e 0 to 0 dl 1789065922 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789065911.604644:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf0817b9500 with x1875971235974784 ext(0->12) 00010000:00010000:1.0:1789065911.604655:0:6685:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.604656:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 7 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.604711:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 7 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065911.604718:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf0817b9500 00000100:00100000:3.0:1789065911.604740:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1789065911.604749:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235974784:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:3.0:1789065911.605256:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971235974784:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 507us (873us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1789065911.605265:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00002000:00100000:3.0:1789065911.605296:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9cf0817b9500 x1875971235974784/t4294967305(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:557/0 lens 504/448 e 0 to 0 dl 1789065922 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789065911.605304:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf0817b9500 with x1875971235974784 ext(0->12) 00010000:00010000:3.0:1789065911.605310:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 9 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.605322:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 9 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065911.605330:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf0817b9500 00000100:00100000:3.0:1789065911.616834:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.617264:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235974912 00000100:00100000:2.0:1789065911.617279:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235974912 00010000:00010000:2.0:1789065911.617337:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 9 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065911.617383:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1789065911.617393:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2350:x1875971235974912:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065911.617410:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789065911.617431:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789065911.617434:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789065910 00002000:00010000:2.0:1789065911.617437:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789065910 00002000:00010000:2.0:1789065911.617439:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789065910 00010000:00010000:2.0:1789065911.617445:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 9 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.617459:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 9 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.617483:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ad6c00/0x7555615576c82fc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde6b expref: 9 pid: 6880 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.617526:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065911.617530:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065911.617537:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.617590:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.617627:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065911.617687:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2350:x1875971235974912:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 295us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.617695:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00010000:00010000:1.0:1789065911.617924:0:6685:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.617936:0:6685:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.617965:0:6685:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.617973:0:6685:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.617981:0:6685:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.617988:0:6685:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789065911.617992:0:6685:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.618013:0:6685:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.618027:0:6685:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.618033:0:6685:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c83014 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065911.618104:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235974656:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 18400us (18593us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065911.618112:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:3.0:1789065911.631255:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.631482:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235975168 00000100:00100000:0.0:1789065911.631504:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235975168 00000100:00100000:0.0:1789065911.631600:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:0.0:1789065911.631611:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11368:x1875971235975168:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:0.0:1789065911.631678:0:5842:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde87 expref: 25 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789065911.631931:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1789065911.631979:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:0.0:1789065911.632501:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:0.0:1789065911.632587:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.632604:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 29 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.632612:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.632647:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 29 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.632661:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 29 pid: 8255 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065911.632684:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0817b9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875971258004096:192.168.204.23@tcp:104: 00000100:00100000:0.0:1789065911.632760:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789065911.637081:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0817b9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5842:1875971258004096:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065911.637116:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065911.639947:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.640158:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235975296 00000100:00100000:2.0:1789065911.640170:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235975296 00010000:00010000:2.0:1789065911.640213:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 30 pid: 8255 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065911.640265:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:2.0:1789065911.640276:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+30:2348:x1875971235975296:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065911.640292:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065911.640300:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 30 pid: 8255 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.640313:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 30 pid: 8255 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.640355:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c82fb2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde5d expref: 30 pid: 8255 timeout: 470 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.640373:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:2.0:1789065911.640379:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.640388:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.640395:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.640430:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065911.640490:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2348:x1875971235975296:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 216us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.640510:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00010000:00010000:0.0:1789065911.641050:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065911.641061:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789065911.641190:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1789065911.641419:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1789065911.641585:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0817b9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971258004224:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789065911.641639:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065911.641666:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73840 going to sleep for 11 seconds 00000100:00100000:2.0:1789065911.641932:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258004224 00000100:00100000:2.0:1789065911.641939:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258004224 00000100:00100000:2.0:1789065911.641982:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789065911.641990:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875971258004224:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789065911.642084:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875971258004224:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.642092:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789065911.642169:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0817b9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971258004224:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789065911.642671:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1789065911.642738:0:5842:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf050e73480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971258004352:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1789065911.642786:0:5842:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065911.642808:0:5842:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fef3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065911.643080:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258004352 00000100:00100000:2.0:1789065911.643086:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258004352 00000100:00100000:2.0:1789065911.643113:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789065911.643120:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1875971258004352:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789065911.643301:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5842:x1875971258004352:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 181us (514us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1789065911.643309:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789065911.643684:0:5842:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf050e73480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5842:1875971258004352:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789065911.643742:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1789065911.643801:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.643812:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.643831:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.643837:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065911.643842:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.643850:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.643863:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065911.643866:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789065911.643870:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065911.643875:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048c00/0x7555615576c8301b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789065911.644057:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789065911.644156:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1789065911.644168:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 370837619128ns, next at 371837617245ns, rc = 0 00000001:00080000:1.0:1789065911.644174:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1789065911.644393:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:1.0:1789065911.644397:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789065911.644403:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde87 expref: 33 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065911.644733:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba6850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11368:x1875971235975168:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 13123us (13497us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1789065911.644764:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00000020:00080000:1.0:1789065911.644768:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789065911.649661:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.649846:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235975424 00000100:00100000:2.0:1789065911.649856:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235975424 00000100:00100000:2.0:1789065911.649915:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 147 00000100:00100000:2.0:1789065911.649925:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11368:x1875971235975424:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065911.649948:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.649970:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde8e expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.650028:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde8e expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.650052:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde8e expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.650072:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065911.650075:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065911.650079:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1da00, rc 0) 00000100:00100000:2.0:1789065911.650167:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11368:x1875971235975424:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 244us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.650174:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 147 00000100:00100000:3.0:1789065911.654119:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065911.654288:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235975680 00000100:00100000:1.0:1789065911.654298:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235975680 00000100:00100000:1.0:1789065911.654356:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:1.0:1789065911.654365:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11368:x1875971235975680:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789065911.654734:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11368:x1875971235975680:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 368us (621us total) trans 4294967433 rc 0/0 00000100:00100000:1.0:1789065911.654850:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:1.0:1789065911.717248:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065911.717306:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065911.717353:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065911.717432:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235976064 00000100:00100000:3.0:1789065911.717447:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235976064 00000100:00100000:3.0:1789065911.717521:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 176 00000100:00100000:3.0:1789065911.717531:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235976064:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065911.717637:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050e70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2347:x1875971235976064:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 107us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065911.717645:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 176 00000100:00100000:2.0:1789065911.717810:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235975808 00000100:00100000:2.0:1789065911.717815:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235975808 00000100:00100000:2.0:1789065911.717855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 305 00000100:00100000:2.0:1789065911.717863:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235975808:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065911.717910:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2347:x1875971235975808:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.717917:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 305 00000100:00080000:1.0:1789065911.720463:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065911.723406:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235975936 00000100:00100000:0.0:1789065911.723422:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235975936 00000100:00100000:0.0:1789065911.723603:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:0.0:1789065911.723614:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235975936:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789065911.723713:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235975936:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 100us (6358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065911.723721:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00080000:1.0:1789065911.723941:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789065911.755583:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.755689:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235976320 00000100:00100000:2.0:1789065911.755699:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235976320 00000100:00100000:2.0:1789065911.755778:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:2.0:1789065911.755789:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11378:x1875971235976320:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065911.755823:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.755845:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde95 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065911.755940:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789065911.756064:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83029 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde95 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.756079:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789065911.756083:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065911.756088:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde95 expref: 36 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.756103:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065911.756161:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11378:x1875971235976320:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 374us (622us total) trans 4294967434 rc 301/301 00000100:00100000:2.0:1789065911.756168:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 148 00000100:00100000:3.0:1789065911.760171:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.760325:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235976448 00000100:00100000:2.0:1789065911.760337:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235976448 00000100:00100000:2.0:1789065911.760409:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:2.0:1789065911.760435:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11378:x1875971235976448:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:2.0:1789065911.760535:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760591:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760605:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760623:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760631:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760637:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760740:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760749:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760756:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065911.760816:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760830:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760845:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760852:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760859:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.760863:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760871:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760884:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065911.760887:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.760892:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760899:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760914:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760920:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760926:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760931:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.760939:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760946:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760954:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f700) 00010000:00010000:2.0:1789065911.760957:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.760959:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760966:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8303e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760982:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760988:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760994:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.760999:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1ce00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.761002:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.761008:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.761016:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065911.761018:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.761027:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.761033:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065911.761114:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11378:x1875971235976448:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 681us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065911.761123:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 149 00000100:00100000:1.0:1789065911.764329:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.764430:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235976704 00000100:00100000:0.0:1789065911.764442:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235976704 00000100:00100000:0.0:1789065911.764521:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:0.0:1789065911.764530:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11378:x1875971235976704:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065911.764819:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11378:x1875971235976704:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 289us (501us total) trans 4294967435 rc 0/0 00000100:00100000:0.0:1789065911.764827:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:3.0:1789065911.813930:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065911.814406:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235976960 00000100:00100000:2.0:1789065911.814418:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235976960 00000100:00100000:2.0:1789065911.814530:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 150 00000100:00100000:2.0:1789065911.814542:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11381:x1875971235976960:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065911.814596:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065911.814618:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8304c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcde9c expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814710:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814730:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814745:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814761:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814768:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814797:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814920:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814928:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.814935:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065911.814944:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789065911.815097:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815105:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815111:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815117:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.815121:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815129:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815142:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065911.815145:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.815157:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815163:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815177:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815183:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815189:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815195:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065911.815197:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815204:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815211:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f700) 00010000:00010000:2.0:1789065911.815213:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065911.815215:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815221:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c8305a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815274:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8304c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 39 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815301:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065911.815308:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065911.815310:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065911.815313:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065911.815439:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11381:x1875971235976960:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 899us (1519us total) trans 4294967436 rc 0/0 00000100:00100000:2.0:1789065911.815447:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 150 00000100:00100000:1.0:1789065911.820110:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065911.820330:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235977088 00000100:00100000:3.0:1789065911.820341:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235977088 00000100:00100000:3.0:1789065911.820401:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 151 00000100:00100000:3.0:1789065911.820411:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11381:x1875971235977088:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:3.0:1789065911.820489:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820510:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820522:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820569:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820576:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820582:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820603:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065911.820608:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820616:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820628:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065911.820631:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065911.820637:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065911.820643:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c8306f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065911.820897:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11381:x1875971235977088:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 487us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065911.820905:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 151 00000100:00100000:1.0:1789065911.823453:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065911.823690:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235977344 00000100:00100000:0.0:1789065911.823700:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235977344 00000100:00100000:0.0:1789065911.823790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1789065911.823813:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11381:x1875971235977344:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065911.824095:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+39:11381:x1875971235977344:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 283us (651us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1789065911.824103:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1789065912.181031:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065912.181125:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235977600 00000100:00100000:3.0:1789065912.181135:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235977600 00000100:00100000:3.0:1789065912.181207:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 152 00000100:00100000:3.0:1789065912.181219:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+39:11412:x1875971235977600:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1789065912.181256:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065912.181279:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83076 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdea3 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.181392:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8307d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.181426:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8307d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.181438:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8307d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065912.181451:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789065912.181726:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83076 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdea3 expref: 42 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.181746:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8307d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdea3 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.181755:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065912.181758:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065912.181762:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654c00, rc 0) 00000100:00100000:3.0:1789065912.181842:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+41:11412:x1875971235977600:12345-192.168.204.23@tcp:101:cat.0 Request processed in 625us (820us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789065912.181850:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 152 00000100:00100000:1.0:1789065912.186886:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065912.186990:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235977728 00000100:00100000:3.0:1789065912.187002:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235977728 00000100:00100000:3.0:1789065912.187081:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1789065912.187092:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+41:2348:x1875971235977728:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065912.187115:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065912.187143:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8307d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdea3 expref: 41 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.187186:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065912.187193:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065912.187273:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+40:2348:x1875971235977728:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 182us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065912.187281:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1789065912.197050:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065912.197154:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235977984 00000100:00100000:0.0:1789065912.197166:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235977984 00000100:00100000:0.0:1789065912.197244:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:0.0:1789065912.197256:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+40:11412:x1875971235977984:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1789065912.197512:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+41:11412:x1875971235977984:12345-192.168.204.23@tcp:35:cat.0 Request processed in 257us (471us total) trans 4294967439 rc 0/0 00000100:00100000:0.0:1789065912.197519:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00010000:00010000:2.0:1789065912.294041:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065912.300039:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065912.300158:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235978240 00000100:00100000:2.0:1789065912.300168:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235978240 00000100:00100000:2.0:1789065912.300251:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:2.0:1789065912.300263:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+41:11418:x1875971235978240:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1789065912.300288:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065912.300291:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789065912.300321:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c82fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde79 expref: 41 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.300341:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065912.300347:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065912.300359:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8308b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdeaa expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.300467:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.300512:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.300522:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.300624:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 41 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.300920:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 41 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065912.300937:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258004480:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065912.301092:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf058202c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789065912.310257:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258004480:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065912.310299:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065912.310778:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065912.310851:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235978368 00000100:00100000:2.0:1789065912.310859:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235978368 00010000:00010000:2.0:1789065912.310898:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065912.310935:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:2.0:1789065912.310944:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+42:2347:x1875971235978368:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065912.310958:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065912.310979:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.310990:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.311025:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcde9c expref: 42 pid: 5840 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.311041:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065912.311045:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.311055:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.311063:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.311092:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065912.311151:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+41:2347:x1875971235978368:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 208us (374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065912.311158:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00010000:00010000:1.0:1789065912.311351:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.311359:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065912.311376:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1789065912.311536:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8308b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 42 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.311579:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 41 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.311588:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:1.0:1789065912.311591:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789065912.311594:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1de00, rc 0) 00000100:00100000:1.0:1789065912.311620:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+41:11418:x1875971235978240:12345-192.168.204.23@tcp:101:dd.0 Request processed in 11361us (11595us total) trans 4294967440 rc 0/0 00000100:00100000:1.0:1789065912.311627:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 153 00000100:00100000:1.0:1789065912.318750:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065912.318874:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235978624 00000100:00100000:3.0:1789065912.318884:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235978624 00000100:00100000:3.0:1789065912.318939:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 154 00000100:00100000:3.0:1789065912.318950:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+41:11418:x1875971235978624:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:3.0:1789065912.319260:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.319278:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.319290:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789065912.319344:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:3.0:1789065912.319366:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000b9787cbe reply state 000000005230ab61 transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065912.319375:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789065912.319467:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+44:11418:x1875971235978624:12345-192.168.204.23@tcp:36:dd.0 Request processed in 518us (725us total) trans 4294967442 rc 0/0 00000100:00100000:3.0:1789065912.319474:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 154 00000020:00080000:3.0:1789065912.319479:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789065912.328047:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.328066:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.328076:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.328082:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065912.328088:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.328096:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.328112:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065912.328115:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065912.328121:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.328139:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789065912.537390:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967439 is committed 00000001:00080000:1.0:1789065912.537430:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967440 is committed 00000004:00080000:1.0:1789065912.537443:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789065912.537469:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf05f059480 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1789065912.537474:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf050c15100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf05f0599c0 00000020:00080000:1.0:1789065912.537478:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf050c15e00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf080ffc800 00000001:00080000:1.0:1789065912.537513:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000100:00100000:0.0:1789065912.537725:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065912.537747:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258004608:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1789065912.538333:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065912.538627:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258004608 00000100:00100000:2.0:1789065912.538636:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258004608 00000100:00100000:2.0:1789065912.538693:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789065912.538703:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258004608:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789065912.538729:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:2.0:1789065912.538765:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa2fab6, atime: 0x6aa2fab6, ctime: 0x6aa2fab6, blocks: 0x1 00010000:00010000:2.0:1789065912.538790:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.538809:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=371s v=(0 0) 00010000:00010000:2.0:1789065912.538813:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065912.538821:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.538838:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.538849:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.538858:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.538900:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789065912.539492:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971258004608:12345-0@lo:6:osp-syn-1-0.0 Request processed in 789us (1160us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789065912.539502:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:2.0:1789065912.539586:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf0508f8000/2, rc 0, transno 4294967307 00000100:00100000:2.0:1789065912.539593:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258004608:0@lo:6:osp-syn-1-0.0 00000020:00080000:3.0:1789065912.539877:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789065912.540025:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1789065912.540116:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065912.540126:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065912.540145:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065912.540149:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065912.540158:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065912.540175:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065912.540191:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c830a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065912.540214:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065912.540224:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065912.540226:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065912.662108:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065912.662338:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235978752 00000100:00100000:3.0:1789065912.662349:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235978752 00000100:00100000:3.0:1789065912.662412:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 155 00000100:00100000:3.0:1789065912.662422:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+16:11432:x1875971235978752:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:3.0:1789065912.662446:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065912.662466:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdeb1 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662589:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662605:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662617:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662632:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662639:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662646:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662922:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662934:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662942:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.662975:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 17 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.663001:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 17 pid: 5838 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065912.663015:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258004736:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065912.663150:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f986c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065912.666632:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258004736:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065912.666667:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065912.666810:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065912.666890:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235979008 00000100:00100000:0.0:1789065912.666898:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235979008 00000100:00100000:0.0:1789065912.666964:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1789065912.666974:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:5591:x1875971235979008:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789065912.667441:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:5591:x1875971235979008:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 467us (630us total) trans 4294967443 rc 0/0 00000100:00100000:0.0:1789065912.667449:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1789065912.669850:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065912.669978:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235979136 00000100:00100000:3.0:1789065912.669988:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235979136 00010000:00010000:3.0:1789065912.670029:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 19 pid: 5838 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065912.670073:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:3.0:1789065912.670083:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c198850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:2347:x1875971235979136:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065912.670099:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065912.670105:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 19 pid: 5838 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.670118:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 19 pid: 5838 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.670140:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83092 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeaa expref: 19 pid: 5838 timeout: 471 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.670171:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065912.670177:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.670195:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.670203:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.670694:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065912.670762:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c198850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2347:x1875971235979136:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 677us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065912.670771:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00010000:00010000:2.0:1789065912.681508:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681527:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065912.681625:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789065912.681629:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065912.681657:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681674:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681685:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681691:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681699:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681705:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065912.681709:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681716:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681733:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065912.681736:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065912.681741:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681748:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c830b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681778:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681784:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681790:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681795:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065912.681798:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681804:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681823:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043e52c00) 00010000:00010000:2.0:1789065912.681825:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065912.681829:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.681834:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c830bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.682072:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c830ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb1 expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.682089:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb1 expref: 17 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065912.682106:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065912.682109:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065912.682112:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655a00, rc 0) 00000100:00100000:2.0:1789065912.682205:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+17:11432:x1875971235978752:12345-192.168.204.23@tcp:101:stat.0 Request processed in 19783us (20105us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065912.682224:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 155 00000100:00100000:0.0:1789065912.793038:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065912.793332:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235979392 00000100:00100000:3.0:1789065912.793344:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235979392 00000100:00100000:3.0:1789065912.793422:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 156 00000100:00100000:3.0:1789065912.793436:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+17:11438:x1875971235979392:12345-192.168.204.23@tcp:36:truncate.0 00010000:00010000:3.0:1789065912.793505:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065912.793539:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb1 expref: 17 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.793706:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065912.793713:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789065912.794109:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.794123:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065912.794143:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789065912.794193:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:3.0:1789065912.794225:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000c7a7decd reply state 0000000011be3e3b transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065912.794234:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789065912.794476:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11438:x1875971235979392:12345-192.168.204.23@tcp:36:truncate.0 Request processed in 1041us (1446us total) trans 4294967445 rc 0/0 00000100:00100000:3.0:1789065912.794485:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 156 00000020:00080000:3.0:1789065912.794490:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000040:00080000:3.0:1789065912.806177:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065912.806200:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789065912.807690:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1789065912.807701:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1789065912.814957:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.814974:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.815001:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.815008:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065912.815013:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.815022:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.815041:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:1.0:1789065912.815044:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065912.815049:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065912.815056:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c830ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065913.061281:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065913.061983:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235979520 00000100:00100000:1.0:1789065913.061997:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235979520 00000100:00100000:1.0:1789065913.062080:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 157 00000100:00100000:1.0:1789065913.062092:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11452:x1875971235979520:12345-192.168.204.23@tcp:101:stat.0 00010000:00010000:1.0:1789065913.062132:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065913.062158:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6c00/0x7555615576c830d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdeb8 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.062375:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.062402:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.062427:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.062445:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.062452:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.062459:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789065913.062745:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789065913.063842:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063859:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063867:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065913.063907:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1789065913.063911:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065913.063930:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063940:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063948:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063964:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063971:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063977:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065913.063982:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.063990:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064003:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:1.0:1789065913.064005:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065913.064010:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064016:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c830d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064029:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064036:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064040:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064045:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789065913.064053:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064060:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064067:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf06a8c0300) 00010000:00010000:1.0:1789065913.064069:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065913.064072:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064078:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c830df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064299:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6c00/0x7555615576c830d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064321:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 19 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.064329:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:1.0:1789065913.064331:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065913.064334:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6800, rc 0) 00000100:00100000:1.0:1789065913.064754:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11452:x1875971235979520:12345-192.168.204.23@tcp:101:stat.0 Request processed in 2662us (3481us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065913.064763:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 157 00000100:00100000:0.0:1789065913.260628:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.260846:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235979776 00000100:00100000:2.0:1789065913.260856:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235979776 00000100:00100000:2.0:1789065913.260922:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:2.0:1789065913.260932:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11462:x1875971235979776:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065913.260951:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065913.260972:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c830ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdebf expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065913.261066:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789065913.261355:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c830ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdebf expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.261372:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789065913.261376:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065913.261382:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c830ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdebf expref: 21 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.261396:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c200, rc 0) 00000100:00100000:2.0:1789065913.261463:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11462:x1875971235979776:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 532us (845us total) trans 4294967446 rc 301/301 00000100:00100000:2.0:1789065913.261484:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 158 00000100:00100000:1.0:1789065913.266284:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065913.266486:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235980032 00000100:00100000:0.0:1789065913.266498:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235980032 00000100:00100000:0.0:1789065913.266603:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:0.0:1789065913.266614:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11462:x1875971235980032:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065913.266866:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba6450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+21:11462:x1875971235980032:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 253us (591us total) trans 4294967447 rc 0/0 00000100:00100000:0.0:1789065913.266874:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00010000:00010000:2.0:1789065913.318437:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065913.387145:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065913.387333:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235980288 00000100:00100000:3.0:1789065913.387343:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235980288 00000100:00100000:3.0:1789065913.387405:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 159 00000100:00100000:3.0:1789065913.387416:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+21:11469:x1875971235980288:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065913.387440:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065913.387471:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdec6 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.387595:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.387611:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.387634:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.387669:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 22 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.387684:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 22 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065913.387697:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258004864:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065913.387865:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065913.400920:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.401013:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235980416 00000100:00100000:2.0:1789065913.401024:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235980416 00010000:00010000:2.0:1789065913.401080:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 23 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065913.401135:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:2.0:1789065913.401146:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+23:2348:x1875971235980416:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065913.401506:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065913.401517:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 23 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.401530:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 23 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.401597:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065913.401603:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.401612:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.401620:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.401639:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065913.401702:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+23:2348:x1875971235980416:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 558us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065913.401727:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00010000:00010000:3.0:1789065913.402224:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c830e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdeb8 expref: 22 pid: 5838 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065913.402243:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258004864:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065913.402264:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.402273:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.402279:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065913.402298:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1789065913.402453:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c830fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 23 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.402480:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 22 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.402488:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065913.402490:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789065913.402493:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655800, rc 0) 00000100:00100000:3.0:1789065913.402544:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+22:11469:x1875971235980288:12345-192.168.204.23@tcp:101:bash.0 Request processed in 15130us (15408us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1789065913.402600:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 159 00000100:00100000:1.0:1789065913.408405:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.408509:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235980672 00000100:00100000:2.0:1789065913.408520:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235980672 00000100:00100000:2.0:1789065913.408613:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 160 00000100:00100000:2.0:1789065913.408624:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+22:11469:x1875971235980672:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:2.0:1789065913.408913:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.408931:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.408943:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065913.408993:0:5840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:2.0:1789065913.409019:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000e70d2818 reply state 00000000a235d7d4 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065913.409027:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065913.409121:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11469:x1875971235980672:12345-192.168.204.23@tcp:36:bash.0 Request processed in 499us (725us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1789065913.409128:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 160 00000020:00080000:2.0:1789065913.409133:0:5840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789065913.413698:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.413719:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.413727:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.413734:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065913.413740:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.413747:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.413774:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065913.413778:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065913.413783:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.413804:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83110 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065913.427725:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.427997:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235980800 00000100:00100000:2.0:1789065913.428006:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235980800 00000100:00100000:2.0:1789065913.428118:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 161 00000100:00100000:2.0:1789065913.428129:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11469:x1875971235980800:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065913.428152:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065913.428340:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdecd expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.428442:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.428457:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 25 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.428467:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.428500:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 25 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.428513:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 25 pid: 8255 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065913.428526:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258004992:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065913.428751:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609c900 going to sleep for 11 seconds 00000100:00100000:1.0:1789065913.436291:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065913.436535:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fb100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258004992:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065913.436603:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065913.436733:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235980928 00000100:00100000:0.0:1789065913.436741:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235980928 00010000:00010000:0.0:1789065913.436780:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 26 pid: 8255 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065913.436819:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:0.0:1789065913.436830:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+26:2347:x1875971235980928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065913.436845:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065913.436852:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 26 pid: 8255 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.436864:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 26 pid: 8255 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.436886:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdec6 expref: 26 pid: 8255 timeout: 472 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.436903:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:0.0:1789065913.436926:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.436938:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.436946:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.436973:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065913.437025:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+25:2347:x1875971235980928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 196us (744us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065913.437032:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00010000:00010000:1.0:1789065913.437464:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.437473:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789065913.437526:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789065913.437531:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789065913.437664:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.437698:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdecd expref: 25 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.437716:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdecd expref: 24 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065913.437725:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:1.0:1789065913.437728:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065913.437731:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d800, rc 0) 00000100:00100000:1.0:1789065913.437764:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11469:x1875971235980800:12345-192.168.204.23@tcp:101:bash.0 Request processed in 9637us (10049us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065913.437771:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 161 00000100:00100000:1.0:1789065913.442941:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065913.443027:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235981184 00000100:00100000:0.0:1789065913.443038:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235981184 00000100:00100000:0.0:1789065913.443250:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:0.0:1789065913.443261:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11469:x1875971235981184:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:0.0:1789065913.444076:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11469:x1875971235981184:12345-192.168.204.23@tcp:35:bash.0 Request processed in 813us (1141us total) trans 4294967451 rc 0/0 00000100:00100000:0.0:1789065913.444087:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:1.0:1789065913.604394:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.606470:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235981440 00000100:00100000:2.0:1789065913.606489:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235981440 00000100:00100000:2.0:1789065913.606655:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:2.0:1789065913.606666:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11479:x1875971235981440:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065913.606700:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065913.606722:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcded4 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065913.606826:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:2.0:1789065913.606969:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83125 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcded4 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.606983:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789065913.606987:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065913.606992:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcded4 expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.607007:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065913.607078:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11479:x1875971235981440:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 414us (2692us total) trans 4294967452 rc 301/301 00000100:00100000:2.0:1789065913.607087:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 162 00000100:00100000:1.0:1789065913.612952:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065913.616746:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235981568 00000100:00100000:0.0:1789065913.616762:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235981568 00000100:00100000:0.0:1789065913.616832:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 163 00000100:00100000:0.0:1789065913.616843:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11479:x1875971235981568:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:0.0:1789065913.616927:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.616944:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.616976:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.616993:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617000:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617006:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617353:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617363:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617370:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065913.617418:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617431:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617439:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617445:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617460:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065913.617465:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617472:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617485:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065913.617488:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065913.617492:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617498:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617510:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617515:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617521:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617526:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065913.617529:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617535:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617577:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065913.617579:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065913.617583:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617589:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8313a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617603:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617609:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617614:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617619:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065913.617621:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617626:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617633:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:0.0:1789065913.617635:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065913.617637:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.617642:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065913.617730:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11479:x1875971235981568:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 887us (4787us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065913.617738:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 163 00000100:00100000:1.0:1789065913.623751:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065913.623840:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235981824 00000100:00100000:3.0:1789065913.623851:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235981824 00000100:00100000:3.0:1789065913.623904:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:3.0:1789065913.623915:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11479:x1875971235981824:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1789065913.624398:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+27:11479:x1875971235981824:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 483us (655us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789065913.624406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:1.0:1789065913.690070:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065913.690333:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235982080 00000100:00100000:0.0:1789065913.690344:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235982080 00000100:00100000:0.0:1789065913.690406:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 164 00000100:00100000:0.0:1789065913.690417:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+27:11482:x1875971235982080:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065913.690441:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065913.690463:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdedb expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690582:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690597:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690609:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690624:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690632:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690639:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690951:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8315d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690960:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8315d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.690967:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8315d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065913.690977:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789065913.691069:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691077:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691084:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691091:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065913.691095:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691103:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691115:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065913.691118:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065913.691123:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691138:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8314f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691152:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691631:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691638:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691644:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065913.691647:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691654:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691663:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065913.691666:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065913.691669:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691674:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691718:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdedb expref: 30 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691731:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8315d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdedb expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065913.691745:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:0.0:1789065913.691747:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789065913.691750:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049e00, rc 0) 00000100:00100000:0.0:1789065913.691829:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058046d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11482:x1875971235982080:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1413us (1767us total) trans 4294967454 rc 0/0 00000100:00100000:0.0:1789065913.691837:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 164 00000100:00100000:1.0:1789065913.701787:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065913.701827:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.701922:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235982208 00000100:00100000:2.0:1789065913.701934:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235982208 00000100:00100000:2.0:1789065913.701999:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:2.0:1789065913.702009:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11482:x1875971235982208:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1789065913.702079:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702097:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702123:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702151:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702173:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702207:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702213:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065913.702217:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702225:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702236:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065913.702239:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065913.702244:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.702250:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8316b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065913.702328:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058046300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11482:x1875971235982208:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 319us (549us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065913.702336:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 165 00000100:00100000:3.0:1789065913.707345:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235982336 00000100:00100000:3.0:1789065913.707362:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235982336 00000100:00100000:2.0:1789065913.707521:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1789065913.707533:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2348:x1875971235982336:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065913.707569:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065913.707596:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8315d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdedb expref: 29 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.707615:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789065913.707632:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065913.707705:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+28:2348:x1875971235982336:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 173us (5876us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065913.707713:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789065913.714853:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065913.714945:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235982592 00000100:00100000:0.0:1789065913.714956:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235982592 00000100:00100000:0.0:1789065913.715023:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:0.0:1789065913.715034:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+28:11482:x1875971235982592:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:0.0:1789065913.715506:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11482:x1875971235982592:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 473us (662us total) trans 4294967455 rc 0/0 00000100:00100000:0.0:1789065913.715515:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:1.0:1789065913.942118:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065913.942363:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235982848 00000100:00100000:3.0:1789065913.942373:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235982848 00000100:00100000:3.0:1789065913.942429:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:3.0:1789065913.942439:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11500:x1875971235982848:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1789065913.942465:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065913.942487:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83172 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdee2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.942611:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83179 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.942642:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.942657:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065913.942669:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789065913.942799:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83172 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdee2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.942819:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83179 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdee2 expref: 31 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065913.942826:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:3.0:1789065913.942828:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789065913.942832:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654400, rc 0) 00000100:00100000:3.0:1789065913.942936:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11500:x1875971235982848:12345-192.168.204.23@tcp:101:cat.0 Request processed in 497us (837us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1789065913.942943:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 166 00000100:00100000:1.0:1789065913.992854:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065913.993397:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235982976 00000100:00100000:2.0:1789065913.993409:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235982976 00000100:00100000:2.0:1789065913.993478:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:2.0:1789065913.993490:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11501:x1875971235982976:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065913.993513:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065913.993544:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdee9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.993643:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8318e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.993658:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8318e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.994007:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8318e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065913.994055:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789065913.994059:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065913.994078:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8318e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.994108:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdee9 expref: 33 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.994131:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8318e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdee9 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065913.994232:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065913.994236:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065913.994242:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c600, rc 0) 00000100:00100000:2.0:1789065913.994389:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11501:x1875971235982976:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 901us (1543us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065913.994398:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 167 00000100:00100000:1.0:1789065914.015171:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065914.015761:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235983360 00000100:00100000:3.0:1789065914.015772:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235983360 00000100:00100000:3.0:1789065914.015834:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1789065914.015844:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11501:x1875971235983360:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1789065914.016354:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11501:x1875971235983360:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 508us (1197us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789065914.016363:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:1.0:1789065914.029935:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065914.030068:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235983488 00000100:00100000:0.0:1789065914.030079:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235983488 00000100:00100000:0.0:1789065914.030164:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1789065914.030174:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11501:x1875971235983488:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:0.0:1789065914.030200:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789065914.030226:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8311e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdecd expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.030249:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdee2 expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.030261:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde8e expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.030287:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:0.0:1789065914.030299:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065914.030373:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+30:11501:x1875971235983488:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 200us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065914.030381:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1789065914.037661:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065914.037887:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235983616 00000100:00100000:3.0:1789065914.037911:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235983616 00000100:00100000:3.0:1789065914.037981:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:3.0:1789065914.037992:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+30:11501:x1875971235983616:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:3.0:1789065914.038119:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.038791:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.038811:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789065914.042741:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789065914.042879:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+30:11501:x1875971235983616:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 4884us (5223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065914.042891:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 168 00000100:00100000:1.0:1789065914.099233:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065914.099378:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235983744 00000100:00100000:0.0:1789065914.099388:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235983744 00000100:00100000:0.0:1789065914.099501:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 169 00000100:00100000:0.0:1789065914.099513:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+30:11503:x1875971235983744:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065914.099545:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065914.099615:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c8319c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdef0 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.099686:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.099702:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.099714:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.099727:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.099734:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.099758:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100045:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100054:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100061:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065914.100094:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1789065914.100098:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065914.100114:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100124:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100132:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100138:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100144:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100160:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065914.100164:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100176:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100196:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065914.100200:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065914.100205:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100211:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c831a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100223:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100229:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100234:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100239:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065914.100241:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100246:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100253:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065914.100255:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065914.100257:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100271:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c831aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100301:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c8319c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 32 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100313:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 31 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065914.100321:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:0.0:1789065914.100323:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789065914.100326:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049a00, rc 0) 00000100:00100000:0.0:1789065914.100383:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058045180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11503:x1875971235983744:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 873us (1161us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065914.100391:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 169 00010000:00010000:2.0:1789065914.341944:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789065914.853867:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065914.853877:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789065914.853937:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1789065914.853945:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789065914.854078:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258005120:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789065914.855330:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98300 going to sleep for 11 seconds 00000100:00100000:0.0:1789065914.869420:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbd180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258005120:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789065914.886467:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065914.886669:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235983872 00000100:00100000:1.0:1789065914.886679:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235983872 00000100:00100000:1.0:1789065914.886752:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:1.0:1789065914.886763:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0508fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11514:x1875971235983872:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789065914.886798:0:5839:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789065914.886901:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0508fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11514:x1875971235983872:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 139us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065914.886908:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 170 00000100:00100000:1.0:1789065914.899415:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065914.899618:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235984000 00000100:00100000:2.0:1789065914.899629:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235984000 00000100:00100000:2.0:1789065914.899680:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:2.0:1789065914.899690:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11514:x1875971235984000:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789065914.899779:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899800:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899819:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899837:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899843:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899850:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899908:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899918:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899924:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065914.899961:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1789065914.899966:0:5840:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065914.899978:0:5840:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899990:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.899997:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900004:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900010:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065914.900014:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900021:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900032:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:2.0:1789065914.900041:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065914.900046:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900053:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c831b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900063:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900068:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900074:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900079:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065914.900081:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900087:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900093:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9cf042e0fa00) 00010000:00010000:2.0:1789065914.900096:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065914.900098:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900103:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c831bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900116:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900128:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900134:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900138:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065914.900141:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900146:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900152:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:2.0:1789065914.900154:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065914.900156:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.900162:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065914.900245:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058045880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11514:x1875971235984000:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 554us (837us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065914.900254:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 171 00000100:00100000:0.0:1789065914.912113:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065914.913000:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235984256 00000100:00100000:3.0:1789065914.913012:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235984256 00000100:00100000:3.0:1789065914.913085:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:3.0:1789065914.913107:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11514:x1875971235984256:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065914.913131:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065914.913153:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdef7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.913893:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.913911:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.913925:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065914.913939:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1789065914.914452:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914464:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914472:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914479:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065914.914484:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914493:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914508:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:3.0:1789065914.914511:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789065914.914517:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914537:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914625:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831cd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef7 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914637:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:3.0:1789065914.914640:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065914.914644:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef7 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.914655:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654400, rc 0) 00000100:00100000:3.0:1789065914.914731:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11514:x1875971235984256:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1635us (2626us total) trans 4294967458 rc 301/301 00000100:00100000:3.0:1789065914.914741:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 172 00000100:00100000:3.0:1789065914.933276:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065914.944214:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235984384 00000100:00100000:2.0:1789065914.944230:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235984384 00000100:00100000:2.0:1789065914.944300:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:2.0:1789065914.944312:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11514:x1875971235984384:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789065914.944351:0:5840:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789065914.946207:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11514:x1875971235984384:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 1889us (12932us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065914.946221:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 173 00000100:00100000:1.0:1789065914.958894:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065914.959501:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235984640 00000100:00100000:2.0:1789065914.959514:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235984640 00000100:00100000:2.0:1789065914.959605:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 174 00000100:00100000:2.0:1789065914.959616:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11514:x1875971235984640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065914.959638:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065914.959643:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789065914.959668:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8318e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdee9 expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065914.959687:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065914.959693:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065914.959705:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdefe expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789065914.963524:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1789065914.965575:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.965599:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.965613:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.965701:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c831e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdefe expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.965722:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdefe expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.965730:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065914.965733:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065914.965745:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654400, rc 0) 00000100:00100000:3.0:1789065914.965825:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11514:x1875971235984640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 6210us (6942us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1789065914.965835:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 174 00000100:00100000:0.0:1789065914.975891:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065914.975986:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235984896 00000100:00100000:3.0:1789065914.976008:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235984896 00000100:00100000:3.0:1789065914.976078:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 175 00000100:00100000:3.0:1789065914.976088:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11514:x1875971235984896:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789065914.976775:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065914.977185:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c831e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdefe expref: 33 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977206:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065914.977217:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789065914.977385:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977401:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977428:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977494:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977502:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977508:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977894:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977903:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977910:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977917:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065914.977921:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977929:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977939:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065914.977942:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065914.977946:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977961:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c831f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977973:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977980:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977985:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.977991:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065914.978040:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.978047:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.978055:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xd6146d5a (ffff9cf043e52600) 00010000:00010000:3.0:1789065914.978188:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065914.978193:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065914.978200:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c831fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xd6146d5a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065914.978437:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11514:x1875971235984896:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 2346us (2552us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789065914.978447:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 175 00000100:00100000:0.0:1789065914.997656:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065914.997783:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235985024 00000100:00100000:1.0:1789065914.997793:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235985024 00000100:00100000:1.0:1789065914.997855:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 176 00000100:00100000:1.0:1789065914.997866:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11514:x1875971235985024:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065914.997885:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065914.997910:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6c00/0x7555615576c83205 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf05 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065914.997960:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065914.997973:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065914.997985:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065914.998079:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6c00/0x7555615576c83205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 34 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065914.998097:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 33 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065914.998105:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:1.0:1789065914.998108:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789065914.998112:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7400, rc 0) 00000100:00100000:1.0:1789065914.998184:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ae67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11514:x1875971235985024:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 319us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065914.998191:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 176 00000100:00100000:2.0:1789065915.006304:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.006773:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235985280 00000100:00100000:3.0:1789065915.006785:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235985280 00000100:00080000:2.0:1789065915.006880:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065915.006883:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 177 00000100:00100000:3.0:1789065915.006897:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+33:11514:x1875971235985280:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789065915.007146:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.007180:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.007196:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789065915.007515:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1789065915.007525:0:5840:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 374200976262ns, next at 375200973347ns, rc = 0 00000004:00010000:3.0:1789065915.008226:0:5840:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000f09fc0b4 reply state 0000000095cad4c6 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.008240:0:5840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789065915.008382:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11514:x1875971235985280:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1484us (2083us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1789065915.008391:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 177 00010000:00010000:3.0:1789065915.015835:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.015863:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.015872:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.015897:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065915.015903:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.015921:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.015941:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:3.0:1789065915.015945:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789065915.015950:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.015957:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.025832:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.027401:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235985408 00000100:00100000:3.0:1789065915.027416:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235985408 00000100:00100000:3.0:1789065915.027480:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:3.0:1789065915.027490:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11514:x1875971235985408:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065915.027514:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065915.027539:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf0c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.027626:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.027642:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 35 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.028267:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:3.0:1789065915.028273:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789065915.028278:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655800, rc 0) 00000100:00100000:3.0:1789065915.028409:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11514:x1875971235985408:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 918us (2584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065915.028417:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 178 00000100:00100000:0.0:1789065915.043377:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065915.043455:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235985536 00000100:00100000:1.0:1789065915.043464:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235985536 00000100:00100000:1.0:1789065915.043579:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:1.0:1789065915.043590:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235985536:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789065915.044325:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235985536:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 735us (954us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1789065915.044345:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00080000:3.0:1789065915.046896:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065915.052754:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.053232:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235985792 00000100:00100000:2.0:1789065915.053244:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235985792 00000100:00100000:2.0:1789065915.053355:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:2.0:1789065915.053366:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11514:x1875971235985792:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789065915.053651:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11514:x1875971235985792:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 286us (908us total) trans 4294967461 rc 0/0 00000100:00100000:2.0:1789065915.053659:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1789065915.063503:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.066607:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986048 00000100:00100000:2.0:1789065915.066623:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986048 00000100:00100000:2.0:1789065915.067536:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 179 00000100:00100000:2.0:1789065915.067576:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11514:x1875971235986048:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789065915.067721:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11514:x1875971235986048:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 173us (4230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065915.067741:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 179 00000100:00100000:0.0:1789065915.072463:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065915.072504:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986176 00000100:00100000:0.0:1789065915.072515:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986176 00000100:00100000:0.0:1789065915.072584:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 180 00000100:00100000:0.0:1789065915.072595:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11514:x1875971235986176:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065915.072629:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065915.072651:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c83221 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf13 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.072724:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c83228 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.072888:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c83228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.072901:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c83228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065915.072936:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789065915.072953:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c83228 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.072980:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048e00/0x7555615576c83221 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf13 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.072998:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c83228 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf13 expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.073007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:0.0:1789065915.073010:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789065915.073013:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049400, rc 0) 00000100:00100000:0.0:1789065915.073072:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11514:x1875971235986176:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 479us (618us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.073080:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 180 00000100:00100000:0.0:1789065915.084609:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.090950:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986304 00000100:00100000:2.0:1789065915.090967:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986304 00000100:00100000:2.0:1789065915.091029:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:2.0:1789065915.091040:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235986304:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065915.091060:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065915.091081:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf1a expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789065915.091108:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2faba, blocks: 0x1 00010000:00010000:2.0:1789065915.091144:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=374s v=(0 0) 00010000:00010000:2.0:1789065915.091148:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065915.091157:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.091184:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 8 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.091197:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065915.091264:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235986304:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 225us (6665us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065915.091271:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000040:00080000:0.0:1789065915.100156:0:12455:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789065915.100177:0:12455:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789065915.100230:0:12455:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1789065915.100238:0:12455:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789065915.110866:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.113746:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986560 00000100:00100000:3.0:1789065915.113759:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986560 00000100:00100000:0.0:1789065915.113989:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 181 00000100:00100000:0.0:1789065915.114002:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11514:x1875971235986560:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789065915.114502:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b275880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11514:x1875971235986560:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 496us (3636us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.114512:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 181 00000100:00100000:2.0:1789065915.139540:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.139655:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986688 00000100:00100000:3.0:1789065915.139665:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986688 00000100:00100000:3.0:1789065915.139723:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:3.0:1789065915.139734:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+8:11514:x1875971235986688:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065915.139762:0:6880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065915.139789:0:6880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf21 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.139822:0:6880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.139831:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065915.139835:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065915.139840:0:6880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 9 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.139887:0:6880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.139901:0:6880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.139915:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07edbe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6880:1875971258005248:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065915.140007:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065915.153968:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07edbe680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6880:1875971258005248:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065915.154013:0:6880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 9 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.154038:0:6880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654800, rc 0) 00000100:00100000:0.0:1789065915.154103:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:11514:x1875971235986688:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 14369us (14570us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.154114:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:0.0:1789065915.165977:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.166112:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986816 00000100:00100000:2.0:1789065915.166122:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986816 00010000:00010000:2.0:1789065915.166181:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.166223:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:2.0:1789065915.166232:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2347:x1875971235986816:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065915.166248:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065915.166272:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.166285:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.166309:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e90892ee/0x7555615576c8322f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf1a expref: 9 pid: 6687 timeout: 474 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.166324:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065915.166329:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065915.166337:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.166346:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.166382:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.166411:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073fbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1875971258005376:192.168.204.23@tcp:105: 00000100:00100000:2.0:1789065915.166501:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609c300 going to sleep for 11 seconds 00000100:00100000:3.0:1789065915.182514:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073fbaa00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1875971258005376:192.168.204.23@tcp:105: 00010000:00010000:3.0:1789065915.182542:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065915.182608:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235986816:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 16376us (16641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065915.182619:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:1.0:1789065915.188602:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065915.188679:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235986944 00000100:00100000:0.0:1789065915.188689:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235986944 00002000:00100000:0.0:1789065915.188739:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cf058046a00 x1875971235986944/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:561/0 lens 504/0 e 0 to 0 dl 1789065926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065915.188750:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf058046a00 with x1875971235986944 ext(0->8) 00002000:00010000:0.0:1789065915.188756:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf058046a00 00000100:00100000:0.0:1789065915.188797:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:0.0:1789065915.188806:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2349:x1875971235986944:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789065915.189445:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058046a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2349:x1875971235986944:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 634us (849us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789065915.189456:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00002000:00100000:0.0:1789065915.189465:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9cf058046a00 x1875971235986944/t4294967315(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:561/0 lens 504/448 e 0 to 0 dl 1789065926 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065915.189474:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf058046a00 with x1875971235986944 ext(0->8) 00002000:00010000:0.0:1789065915.189478:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf058046a00 00000100:00100000:3.0:1789065915.211820:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065915.211892:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235987072 00000100:00100000:1.0:1789065915.211902:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235987072 00000100:00100000:1.0:1789065915.211956:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 182 00000100:00100000:1.0:1789065915.211965:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11514:x1875971235987072:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1789065915.258818:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edbe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11514:x1875971235987072:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 46838us (46992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065915.258834:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 182 00000001:00080000:3.0:1789065915.258879:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967455 is committed 00000001:00080000:3.0:1789065915.258894:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000004:00080000:3.0:1789065915.258911:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1789065915.258946:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:3.0:1789065915.261457:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065915.262427:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf073e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258005504:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789065915.262483:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065915.262586:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235987200 00000100:00100000:0.0:1789065915.262594:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235987200 00000100:00100000:0.0:1789065915.262639:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258005504 00000100:00100000:0.0:1789065915.262642:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258005504 00000100:00100000:0.0:1789065915.262680:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:0.0:1789065915.262690:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2348:x1875971235987200:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00080000:0.0:1789065915.262751:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065915.262765:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789065915.262773:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258005504:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789065915.262919:0:6880:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1789065915.262922:0:6880:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789065914 00002000:00010000:0.0:1789065915.262925:0:6880:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789065915.262926:0:6880:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789065914 -> 1789065914 00002000:00010000:0.0:1789065915.262928:0:6880:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000020:00080000:3.0:1789065915.263015:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:3.0:1789065915.263034:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1789065915.263267:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971258005504:12345-0@lo:2:osp-syn-0-0.0 Request processed in 493us (782us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1789065915.263285:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000004:00080000:1.0:1789065915.263426:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf073e63800/2, rc 0, transno 4294967316 00000100:00100000:1.0:1789065915.263433:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf073e63800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258005504:0@lo:2:osp-syn-0-0.0 00000001:00080000:3.0:1789065915.289117:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1789065915.289206:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000100:00100000:0.0:1789065915.289367:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e60000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235987200:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 26671us (27913us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.289378:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:3.0:1789065915.292603:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.292681:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235987456 00000100:00100000:2.0:1789065915.292691:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235987456 00000100:00100000:2.0:1789065915.292748:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 183 00000100:00100000:2.0:1789065915.292758:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11514:x1875971235987456:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789065915.292820:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065915.292849:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049400/0x7555615576c83228 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf13 expref: 18 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.292865:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:2.0:1789065915.292871:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065915.292900:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.292913:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.292922:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065915.293420:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000873ece9e reply state 000000004b2adac4 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.293430:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065915.293524:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11514:x1875971235987456:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 765us (928us total) trans 4294967462 rc 0/0 00000100:00100000:2.0:1789065915.293539:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 183 00000100:00100000:3.0:1789065915.298050:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:3.0:1789065915.298631:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.298644:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.298652:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.298660:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065915.298665:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.298672:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.298688:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:3.0:1789065915.298691:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065915.298696:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.298704:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8323d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.298737:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235987584 00000100:00100000:3.0:1789065915.298746:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235987584 00000100:00100000:3.0:1789065915.298810:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1789065915.298819:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235987584:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789065915.299071:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1789065915.299922:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789065914 -> 1789065912 00002000:00010000:3.0:1789065915.299925:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789065910 00002000:00010000:3.0:1789065915.299927:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789065914 -> 1789065912 00002000:00010000:3.0:1789065915.299929:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1789065915.300039:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971235987584:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 1217us (1996us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1789065915.300048:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:2.0:1789065915.309351:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.309684:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235987840 00000100:00100000:3.0:1789065915.309695:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235987840 00000100:00100000:3.0:1789065915.309781:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 184 00000100:00100000:3.0:1789065915.309791:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11514:x1875971235987840:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789065915.309861:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.309878:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.309887:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.309921:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.309934:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 18 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.309961:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081768700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258005632:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065915.310064:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065915.316511:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.317035:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081768700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258005632:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065915.317066:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065915.317128:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235987968 00000100:00100000:0.0:1789065915.317137:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235987968 00010000:00010000:0.0:1789065915.317192:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065915.317506:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:0.0:1789065915.317520:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:2348:x1875971235987968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065915.317535:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065915.317542:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.317577:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.317599:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c8320c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf05 expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.317612:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:0.0:1789065915.317617:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.317627:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.317650:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.317673:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065915.317725:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2348:x1875971235987968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 208us (1224us total) trans 0 rc 0/0 00010000:00010000:3.0:1789065915.318691:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318707:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318741:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318749:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318757:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318774:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065915.318779:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318788:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318818:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:3.0:1789065915.318821:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789065915.318828:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.318835:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83244 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.318907:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073fbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11514:x1875971235987840:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 9113us (9563us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789065915.318917:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 184 00000100:00100000:0.0:1789065915.323366:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:0.0:1789065915.325453:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.325850:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235988096 00000100:00100000:2.0:1789065915.325861:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235988096 00000100:00100000:2.0:1789065915.325959:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:2.0:1789065915.325971:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2350:x1875971235988096:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789065915.326019:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.326041:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.326050:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065915.326055:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065915.326060:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.326107:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.326122:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 8 pid: 6880 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.326150:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971258005760:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065915.326243:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065915.331093:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6688:1875971258005760:192.168.204.23@tcp:104: 00010000:00010000:0.0:1789065915.331137:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065915.333402:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065915.333727:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235988224 00000100:00100000:3.0:1789065915.333736:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235988224 00010000:00010000:3.0:1789065915.333826:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 9 pid: 6880 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.333905:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:3.0:1789065915.333918:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c199450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971235988224:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065915.333935:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065915.333960:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 9 pid: 6880 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.333973:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 9 pid: 6880 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.333996:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c83236 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf21 expref: 9 pid: 6880 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.334030:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065915.334034:0:8446:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065915.334040:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.334048:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.334088:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065915.334219:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334229:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334254:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334263:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334271:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334285:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065915.334289:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334298:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334310:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.334318:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000529fe95a/0x7555615576c8324b lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065915.334386:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2350:x1875971235988096:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 8417us (9007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.334395:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:3.0:1789065915.334911:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c199450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235988224:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 993us (1517us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065915.334920:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1789065915.339195:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.339317:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235988480 00000100:00100000:2.0:1789065915.339329:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235988480 00000100:00100000:2.0:1789065915.339393:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 185 00000100:00100000:2.0:1789065915.339404:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+17:11514:x1875971235988480:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789065915.339488:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339507:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339520:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339762:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339774:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339782:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339815:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 18 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.339830:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 18 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.339845:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258005888:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065915.339919:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789065915.344227:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.344532:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258005888:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065915.344598:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065915.344723:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235988608 00000100:00100000:1.0:1789065915.344730:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235988608 00010000:00010000:1.0:1789065915.344779:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065915.344812:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:1.0:1789065915.344821:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:2347:x1875971235988608:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065915.344836:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065915.344843:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065915.344855:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065915.344878:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c8321a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf0c expref: 19 pid: 5839 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065915.344908:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:1.0:1789065915.344913:0:5825:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065915.344923:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065915.344930:0:5825:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065915.344960:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065915.345219:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2347:x1875971235988608:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 397us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065915.345227:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00010000:00010000:2.0:1789065915.345338:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.345346:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065915.345531:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1789065915.345703:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1789065915.345752:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1789065915.345855:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875971258006016:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789065915.345934:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065915.345975:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065915.346043:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006016 00000100:00100000:0.0:1789065915.346051:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006016 00000100:00100000:0.0:1789065915.346098:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789065915.346107:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875971258006016:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789065915.346203:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875971258006016:12345-0@lo:1000:mdt00_000.0 Request processed in 96us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.346210:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789065915.346464:0:5838:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1789065915.346469:0:5838:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf073e63800, transno 4294967316 00000100:00100000:2.0:1789065915.346490:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875971258006016:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1789065915.346962:0:5838:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1789065915.347023:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875971258006144:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1789065915.347059:0:5838:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065915.347568:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006144 00000100:00100000:0.0:1789065915.347575:0:5843:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006144 00000100:00100000:0.0:1789065915.347606:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789065915.347613:0:5843:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5838:x1875971258006144:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789065915.349442:0:5843:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5838:x1875971258006144:12345-0@lo:1000:mdt00_000.0 Request processed in 1821us (2373us total) trans 4294967318 rc 0/0 00000100:00100000:0.0:1789065915.349455:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789065915.349577:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789065915.349611:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5838:1875971258006144:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789065915.349651:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349660:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349684:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349689:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065915.349693:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349700:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349715:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf06a8c0300) 00010000:00010000:2.0:1789065915.349718:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065915.349723:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349728:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83259 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349759:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349869:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349876:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349880:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065915.349883:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349898:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349907:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:2.0:1789065915.349910:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065915.349913:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349918:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655a00/0x7555615576c83195 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349940:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349952:0:5838:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 21 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349961:0:5838:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.349996:0:5838:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 21 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.350011:0:5838:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 21 pid: 8255 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.350026:0:5838:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258006272:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065915.350226:0:5838:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789065915.355251:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065915.355353:0:5838:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc73480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5838:1875971258006272:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065915.355393:0:5838:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.355622:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235988736 00000100:00100000:3.0:1789065915.355631:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235988736 00010000:00010000:3.0:1789065915.355673:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 22 pid: 8255 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065915.355714:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:3.0:1789065915.355723:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+22:2347:x1875971235988736:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065915.355738:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065915.355745:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 22 pid: 8255 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.355757:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 22 pid: 8255 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.355793:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c831b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdef0 expref: 22 pid: 8255 timeout: 474 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.355808:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:3.0:1789065915.355812:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.355822:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.355829:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.355852:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065915.355904:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058046680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+21:2347:x1875971235988736:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 182us (663us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065915.355911:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00010000:00010000:2.0:1789065915.355974:0:5838:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.355981:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.355993:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.355999:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356005:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356010:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065915.356014:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356021:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356031:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:2.0:1789065915.356033:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065915.356037:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356042:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83260 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356065:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356070:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356076:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356080:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065915.356083:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356089:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356096:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52f00) 00010000:00010000:2.0:1789065915.356098:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789065915.356100:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065915.356106:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83252 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065915.356333:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11514:x1875971235988480:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 16931us (17148us total) trans 4294967467 rc 0/0 00000100:00100000:2.0:1789065915.356341:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 185 00000020:00080000:2.0:1789065915.356345:0:5838:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789065915.357302:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065915.357310:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789065915.357818:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:3.0:1789065915.357827:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789065915.360445:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065915.361108:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235988992 00000100:00100000:1.0:1789065915.361932:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235988992 00000100:00100000:0.0:1789065915.362088:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:0.0:1789065915.362100:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11514:x1875971235988992:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789065915.362876:0:5842:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789065915.362980:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:0.0:1789065915.363028:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.363044:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.363056:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.363065:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.363071:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.363078:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065915.363143:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789065915.363265:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba6c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+22:11514:x1875971235988992:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 1165us (2829us total) trans 4294967469 rc 0/0 00000100:00100000:0.0:1789065915.363275:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000020:00080000:0.0:1789065915.363281:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789065915.364382:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065915.364396:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.364407:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065915.364411:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.364432:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.364449:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9cf043eb1a00) 00010000:00010000:3.0:1789065915.364453:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789065915.364458:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.364464:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049600/0x7555615576c83267 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065915.364486:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065915.364488:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065915.364490:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065915.368074:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065915.558082:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258006400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065915.558191:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065915.566385:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006400 00000100:00100000:0.0:1789065915.566401:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006400 00000100:00100000:0.0:1789065915.566466:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789065915.566475:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971258006400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065915.566502:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789065915.566602:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971258006400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (8410us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065915.566608:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789065915.567910:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258006400:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789065916.389723:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065916.581717:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258006528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065916.581798:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065916.581887:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006528 00000100:00100000:0.0:1789065916.581898:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006528 00000100:00100000:0.0:1789065916.581959:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1789065916.581971:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971258006528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065916.582032:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065916.582083:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b275500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971258006528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065916.582091:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:0.0:1789065916.582114:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065916.582166:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b274380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258006528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065916.582798:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258006784:0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.582845:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065916.582888:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065916.582897:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258006912:0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.582927:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065916.582971:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006784 00000100:00100000:0.0:1789065916.582977:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006784 00000100:00100000:1.0:1789065916.583126:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006912 00000100:00100000:1.0:1789065916.583131:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006912 00000100:00100000:1.0:1789065916.583185:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1789065916.583204:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258006912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065916.583255:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b275c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258006912:12345-0@lo:400:kworker.0 Request processed in 64us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065916.583262:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:1.0:1789065916.583283:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065916.583305:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058045f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258006912:0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.583626:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789065916.583635:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258006784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.583681:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258006784:12345-0@lo:400:kworker.0 Request processed in 46us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065916.583688:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789065916.583781:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971258006656:0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.583816:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065916.583850:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258007168:0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.583878:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065916.583900:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789065916.583906:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258007040:0@lo:400:kworker.0 00000100:00100000:0.0:1789065916.583933:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065916.583963:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258006656 00000100:00100000:0.0:1789065916.583967:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258006656 00000100:00100000:3.0:1789065916.588266:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789065916.588291:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971258006656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065916.588396:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971258006656:12345-0@lo:400:kworker.0 Request processed in 117us (4579us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065916.588405:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:3.0:1789065916.588461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258007168 00000100:00100000:3.0:1789065916.588470:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258007168 00000100:00100000:3.0:1789065916.588582:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789065916.588590:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258007168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065916.588625:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b275f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258007168:12345-0@lo:400:kworker.0 Request processed in 36us (4746us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065916.588644:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1789065916.588709:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058045500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971258006656:0@lo:400:kworker.0 00000100:00100000:3.0:1789065916.588729:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058044e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258007168:0@lo:400:kworker.0 00000100:00100000:3.0:1789065916.588782:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058045c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258006784:0@lo:400:kworker.0 00000100:00080000:1.0:1789065916.594070:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065916.594115:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258007040 00000100:00100000:1.0:1789065916.594128:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258007040 00000100:00100000:1.0:1789065916.594210:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789065916.594221:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1875971258007040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065916.594332:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3298:x1875971258007040:12345-0@lo:400:kworker.0 Request processed in 113us (10398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065916.594339:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789065916.594777:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058047100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258007040:0@lo:400:kworker.0 00000001:00080000:1.0:1789065916.668016:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:1.0:1789065916.668045:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1789065916.835892:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065916.835996:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065916.836032:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065916.836057:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065916.836102:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065916.836937:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235989504 00000100:00100000:1.0:1789065916.836951:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235989504 00000100:00100000:1.0:1789065916.837024:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235989376 00000100:00100000:1.0:1789065916.837028:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235989376 00000100:00100000:1.0:1789065916.837061:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:1.0:1789065916.837074:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235989504:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065916.837162:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235989504:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 90us (1130us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065916.837172:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:1.0:1789065916.837205:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:1.0:1789065916.837214:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235989376:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065916.837248:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971235989376:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 35us (1191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065916.837271:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00080000:1.0:1789065916.837311:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065916.837498:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235989248 00000100:00100000:3.0:1789065916.837504:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235989248 00000100:00100000:3.0:1789065916.837626:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235989632 00000100:00100000:3.0:1789065916.837630:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235989632 00000100:00100000:1.0:1789065916.837683:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 180 00000100:00100000:1.0:1789065916.837690:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+22:2349:x1875971235989248:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065916.837724:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058045f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+22:2349:x1875971235989248:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 35us (1846us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065916.837731:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 180 00000100:00100000:1.0:1789065916.837746:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 181 00000100:00100000:1.0:1789065916.837752:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235989632:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065916.837774:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971235989632:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 23us (1673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065916.837780:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 181 00000100:00100000:3.0:1789065916.837891:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235989120 00000100:00100000:3.0:1789065916.837897:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235989120 00000100:00100000:3.0:1789065916.837963:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 307 00000100:00100000:3.0:1789065916.837973:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235989120:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065916.838003:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971235989120:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 32us (2009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065916.838011:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 307 00000100:00080000:3.0:1789065916.838199:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:2.0:1789065916.990205:0:12509:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065916.990215:0:12509:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065916.990269:0:12509:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789065916.990275:0:12509:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789065917.171903:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.172010:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235989888 00000100:00100000:3.0:1789065917.172022:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235989888 00000100:00100000:3.0:1789065917.172142:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 186 00000100:00100000:3.0:1789065917.172154:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+22:11532:x1875971235989888:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065917.172176:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065917.172198:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c8326e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf28 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.172332:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83275 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.172348:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.172364:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83275 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065917.172376:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789065917.172515:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c8326e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf28 expref: 25 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.172536:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83275 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf28 expref: 24 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.172575:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065917.172580:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789065917.172584:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654800, rc 0) 00000100:00100000:3.0:1789065917.172654:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058045c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11532:x1875971235989888:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 502us (761us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789065917.172662:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 186 00000100:00080000:1.0:1789065917.174239:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065917.175461:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.175538:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235990016 00000100:00100000:0.0:1789065917.175580:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235990016 00000100:00100000:0.0:1789065917.175626:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 187 00000100:00100000:0.0:1789065917.175634:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11532:x1875971235990016:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:0.0:1789065917.175702:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.175717:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.175743:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.175757:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.175764:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.175771:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176015:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176024:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176031:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065917.176270:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176284:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176292:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176299:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176315:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065917.176319:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176327:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176338:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065917.176341:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065917.176346:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176352:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048a00/0x7555615576c83283 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176365:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176370:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176377:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176381:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065917.176384:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176390:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176404:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043eb1800) 00010000:00010000:0.0:1789065917.176406:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065917.176409:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176414:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049c00/0x7555615576c8328a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176426:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176432:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176438:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176443:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065917.176445:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176450:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176456:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043eb1f00) 00010000:00010000:0.0:1789065917.176458:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065917.176460:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.176466:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048400/0x7555615576c83291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065917.176746:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11532:x1875971235990016:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 1109us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065917.176755:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 187 00000100:00100000:0.0:1789065917.246417:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.246500:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235990272 00000100:00100000:3.0:1789065917.246511:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235990272 00000100:00100000:3.0:1789065917.246603:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:3.0:1789065917.246614:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11535:x1875971235990272:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065917.246652:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065917.246672:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83298 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf2f expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.246744:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.246758:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.246770:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.246784:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.246791:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.246798:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247079:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247088:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247106:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065917.247118:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789065917.247228:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247235:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247243:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247250:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.247254:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247262:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247273:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065917.247276:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.247281:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247288:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c8329f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247299:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247305:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247311:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247315:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.247324:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247330:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247338:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043e52400) 00010000:00010000:3.0:1789065917.247340:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.247343:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247349:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247389:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83298 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 27 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247404:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 26 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.247411:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.247413:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065917.247415:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655600, rc 0) 00000100:00100000:3.0:1789065917.247481:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11535:x1875971235990272:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 868us (1073us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1789065917.247489:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 188 00000100:00100000:1.0:1789065917.251998:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.252095:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235990400 00000100:00100000:3.0:1789065917.252108:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235990400 00000100:00100000:3.0:1789065917.252181:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:3.0:1789065917.252192:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11535:x1875971235990400:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:3.0:1789065917.252273:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252290:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252301:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252327:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252334:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252340:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252345:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.252349:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252356:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252366:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.252369:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065917.252374:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.252380:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.252473:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11535:x1875971235990400:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 282us (490us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065917.252479:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 189 00000100:00100000:0.0:1789065917.255595:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.255692:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235990656 00000100:00100000:2.0:1789065917.255702:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235990656 00000100:00100000:2.0:1789065917.255762:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:2.0:1789065917.255782:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11535:x1875971235990656:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1789065917.256031:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+27:11535:x1875971235990656:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 250us (482us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1789065917.256039:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:1.0:1789065917.308491:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.308581:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235990912 00000100:00100000:3.0:1789065917.308593:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235990912 00000100:00100000:3.0:1789065917.308657:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:3.0:1789065917.308669:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+27:11061:x1875971235990912:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065917.308696:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065917.308722:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832c2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf36 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.308836:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.308852:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.308862:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.308902:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.308916:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 28 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.308930:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258007296:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065917.309061:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98180 going to sleep for 11 seconds 00000100:00100000:2.0:1789065917.312380:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.312870:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235991040 00000100:00100000:0.0:1789065917.312881:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235991040 00010000:00010000:0.0:1789065917.312924:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 29 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065917.312967:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:0.0:1789065917.312978:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2348:x1875971235991040:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065917.312993:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065917.313000:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 29 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.313013:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 29 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.313045:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:0.0:1789065917.313051:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.313061:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.313068:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.313113:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065917.313191:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc73100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2348:x1875971235991040:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 214us (824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065917.313198:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00010000:00010000:3.0:1789065917.314579:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf2f expref: 28 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.314604:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258007296:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065917.314631:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.314641:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.314646:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065917.314668:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789065917.314945:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832c2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 29 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.314961:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 28 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.314970:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.314973:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789065917.314976:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655400, rc 0) 00000100:00100000:3.0:1789065917.315209:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058045500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+28:11061:x1875971235990912:12345-192.168.204.23@tcp:101:bash.0 Request processed in 6541us (6727us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789065917.315218:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:2.0:1789065917.317715:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.317848:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235991296 00000100:00100000:3.0:1789065917.317869:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235991296 00000100:00100000:3.0:1789065917.317967:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:3.0:1789065917.317979:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+28:11061:x1875971235991296:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:3.0:1789065917.318283:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.318301:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.318313:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789065917.318370:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:3.0:1789065917.318396:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000c9a7f0d3 reply state 0000000019708150 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.318405:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1789065917.318460:0:5839:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:3.0:1789065917.318655:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11061:x1875971235991296:12345-192.168.204.23@tcp:36:bash.0 Request processed in 675us (947us total) trans 4294967476 rc 0/0 00000100:00100000:3.0:1789065917.318663:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 191 00000020:00080000:3.0:1789065917.318669:0:5839:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1789065917.321881:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.321900:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.321909:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.321915:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.321935:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.321943:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.321961:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.321964:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.321968:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.321975:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065917.322872:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065917.322957:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235991424 00000100:00100000:1.0:1789065917.322968:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235991424 00000100:00100000:1.0:1789065917.323027:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 192 00000100:00100000:1.0:1789065917.323038:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11061:x1875971235991424:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065917.323061:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065917.323082:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c832de lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf3d expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065917.323163:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c832de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf3d expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065917.323190:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c832de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf3d expref: 32 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065917.323211:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:1.0:1789065917.323214:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065917.323217:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7400, rc 0) 00000100:00100000:1.0:1789065917.323277:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11061:x1875971235991424:12345-192.168.204.23@tcp:101:bash.0 Request processed in 240us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065917.323285:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 192 00000100:00100000:0.0:1789065917.327057:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065917.327254:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235991552 00000100:00100000:1.0:1789065917.327265:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235991552 00000100:00100000:1.0:1789065917.327348:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:1.0:1789065917.327359:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:11061:x1875971235991552:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:1.0:1789065917.327378:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065917.327400:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf44 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789065917.327428:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2fab8, atime: 0x6aa2fab6, ctime: 0x6aa2fab8, blocks: 0xb 00010000:00010000:1.0:1789065917.327451:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:1.0:1789065917.327455:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065917.327463:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065917.327484:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 8 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065917.327517:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7600, rc 0) 00000100:00100000:1.0:1789065917.327613:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:11061:x1875971235991552:12345-192.168.204.23@tcp:101:bash.0 Request processed in 255us (564us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065917.327620:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00080000:3.0:1789065917.327689:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065917.331338:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.331454:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235991680 00000100:00100000:0.0:1789065917.331466:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235991680 00002000:00010000:0.0:1789065917.331505:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789065917.331510:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07fc70e00 with x1875971235991680 ext(0->18446744073709551615) 00002000:00010000:0.0:1789065917.331523:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07fc70e00. 00000100:00100000:0.0:1789065917.331629:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:0.0:1789065917.331640:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971235991680:12345-192.168.204.23@tcp:10:bash.0 00002000:00010000:0.0:1789065917.331922:0:6691:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789065917.331926:0:6691:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1789065912 -> 1789065916 00002000:00010000:0.0:1789065917.331929:0:6691:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1789065910 -> 1789065910 00002000:00010000:0.0:1789065917.331931:0:6691:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1789065912 -> 1789065916 00002000:00010000:0.0:1789065917.331934:0:6691:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789065917.332041:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2347:x1875971235991680:12345-192.168.204.23@tcp:10:bash.0 Request processed in 402us (712us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789065917.332049:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00002000:00010000:0.0:1789065917.332053:0:6691:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:0.0:1789065917.332056:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07fc70e00 with x1875971235991680 ext(0->18446744073709551615) 00002000:00010000:0.0:1789065917.332061:0:6691:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07fc70e00. 00010000:00010000:3.0:1789065917.413754:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065917.416813:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.417060:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235991808 00000100:00100000:3.0:1789065917.417070:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235991808 00000100:00100000:3.0:1789065917.417148:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 193 00000100:00100000:3.0:1789065917.417158:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11549:x1875971235991808:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:3.0:1789065917.417231:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417248:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417259:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417273:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417295:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417301:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417591:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417601:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417608:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789065917.417647:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417659:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417666:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417674:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417680:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.417685:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417692:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417711:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065917.417715:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.417722:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417728:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c832ec lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417741:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417747:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417752:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417758:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.417760:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417780:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417787:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043e52400) 00010000:00010000:3.0:1789065917.417790:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.417793:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417799:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c832f3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417824:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417831:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417837:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417842:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.417846:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417853:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417860:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.417863:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.417866:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.417870:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c832fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.417950:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11549:x1875971235991808:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 792us (1144us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065917.417959:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 193 00000100:00100000:1.0:1789065917.458537:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.458918:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235992064 00000100:00100000:2.0:1789065917.458930:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235992064 00000100:00100000:2.0:1789065917.458995:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 194 00000100:00100000:2.0:1789065917.459005:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+32:11552:x1875971235992064:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065917.459027:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065917.459058:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83301 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf4b expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459322:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459338:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459363:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459378:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459386:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459393:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459700:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459711:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459718:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065917.459729:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1789065917.459840:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459848:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459855:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459861:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065917.459872:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459881:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459894:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065917.459898:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065917.459903:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459910:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83308 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459924:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459930:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459937:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459942:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065917.459946:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459952:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459960:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065917.459963:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065917.459972:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.459979:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8330f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.460027:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83301 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf4b expref: 35 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.460190:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf4b expref: 34 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.460197:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789065917.460200:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789065917.460202:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065917.460336:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b270e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11552:x1875971235992064:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1331us (1807us total) trans 4294967477 rc 0/0 00000100:00100000:2.0:1789065917.460345:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 194 00000100:00100000:2.0:1789065917.465448:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.465540:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235992192 00000100:00100000:3.0:1789065917.465649:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235992192 00000100:00100000:3.0:1789065917.465746:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:3.0:1789065917.465785:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11552:x1875971235992192:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:3.0:1789065917.465855:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.465874:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.465884:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.465920:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 34 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.465935:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 34 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.465948:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258007424:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065917.466349:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98000 going to sleep for 11 seconds 00000100:00100000:1.0:1789065917.470511:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.470609:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235992448 00000100:00100000:2.0:1789065917.470620:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235992448 00000100:00100000:2.0:1789065917.470684:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:2.0:1789065917.470697:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+35:5592:x1875971235992448:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789065917.471074:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:5592:x1875971235992448:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 378us (570us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1789065917.471082:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:3.0:1789065917.473406:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258007424:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065917.473439:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065917.475168:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.475258:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235992576 00000100:00100000:3.0:1789065917.475268:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235992576 00010000:00010000:3.0:1789065917.475307:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 36 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065917.475347:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:3.0:1789065917.475379:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+36:2348:x1875971235992576:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065917.475394:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065917.475401:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 36 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.475415:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 36 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.475438:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c832c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf36 expref: 36 pid: 5840 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.475455:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.475461:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.475471:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.475479:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.475510:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065917.475618:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b273b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+35:2348:x1875971235992576:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 240us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065917.475625:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00010000:00010000:2.0:1789065917.476092:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476114:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476156:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476164:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476171:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476177:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065917.476181:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476189:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476200:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789065917.476203:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789065917.476207:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.476213:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83324 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065917.476261:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11552:x1875971235992192:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 10480us (10822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065917.476269:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:1.0:1789065917.479505:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.479749:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235992832 00000100:00100000:2.0:1789065917.479760:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235992832 00000100:00100000:2.0:1789065917.479819:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:2.0:1789065917.479829:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+34:11552:x1875971235992832:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1789065917.480327:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11552:x1875971235992832:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 497us (830us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1789065917.480336:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:1.0:1789065917.604207:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065917.604432:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235993088 00000100:00100000:3.0:1789065917.604443:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235993088 00000100:00100000:3.0:1789065917.604495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:3.0:1789065917.604505:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+35:11563:x1875971235993088:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:3.0:1789065917.604545:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065917.604589:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8332b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf52 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604670:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604683:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604694:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604707:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604713:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604720:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604969:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c83340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604979:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c83340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.604987:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c83340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065917.604997:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1789065917.605101:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605109:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605116:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605133:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.605137:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605144:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605156:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065917.605159:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.605163:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605170:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605186:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605193:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605198:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605202:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.605211:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605217:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605225:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043e52400) 00010000:00010000:3.0:1789065917.605227:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.605231:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605236:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605275:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8332b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf52 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605290:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c83340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf52 expref: 37 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.605297:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789065917.605300:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065917.605303:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655c00, rc 0) 00000100:00100000:3.0:1789065917.605369:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b271880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11563:x1875971235993088:12345-192.168.204.23@tcp:101:cat.0 Request processed in 864us (1170us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1789065917.605376:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:1.0:1789065917.618650:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.619142:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235993344 00000100:00100000:0.0:1789065917.619171:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235993344 00000100:00100000:0.0:1789065917.619239:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:0.0:1789065917.619251:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11563:x1875971235993344:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:0.0:1789065917.619861:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11563:x1875971235993344:12345-192.168.204.23@tcp:35:cat.0 Request processed in 609us (1219us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1789065917.619870:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 54 00000100:00100000:1.0:1789065917.648291:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.648390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235993600 00000100:00100000:0.0:1789065917.648400:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235993600 00000100:00100000:0.0:1789065917.648463:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 197 00000100:00100000:0.0:1789065917.648475:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11564:x1875971235993600:12345-192.168.204.23@tcp:36:rm.0 00010000:00010000:0.0:1789065917.648538:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789065917.648588:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655c00/0x7555615576c83340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf52 expref: 38 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649178:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf4b expref: 37 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649195:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7400/0x7555615576c832de lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf3d expref: 36 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649207:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:0.0:1789065917.649218:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065917.649245:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649260:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649292:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649308:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649316:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.649322:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.651257:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.651280:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.651294:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789065917.653808:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1789065917.653827:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 376847278422ns, next at 377847275176ns, rc = 0 00010000:00010000:0.0:1789065917.653923:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.653940:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.653952:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.653981:0:5839:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654057:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654064:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654089:0:5839:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789065917.654114:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654132:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654139:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654146:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.654178:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065917.654186:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.654202:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065917.654207:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.654215:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654222:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654229:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.654230:0:6701:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043eb1800) 00010000:00010000:3.0:1789065917.654233:0:6701:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789065917.654238:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654238:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9cf043eb1800) 00010000:00010000:0.0:1789065917.654241:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789065917.654244:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048600/0x7555615576c83363 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654244:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.654259:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065917.654259:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c8335c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.654260:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065917.654262:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065917.654281:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654288:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654294:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654298:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065917.654301:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654307:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654316:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065917.654318:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065917.654321:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.654325:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c8334e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789065917.654335:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000006b3f487f reply state 00000000a7c795ae transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065917.654344:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789065917.654447:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b272a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+37:11564:x1875971235993600:12345-192.168.204.23@tcp:36:rm.0 Request processed in 5971us (6162us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789065917.654456:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 197 00010000:00010000:3.0:1789065917.660105:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.660133:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.660141:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.660148:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.660154:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.660185:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.660203:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf043eb1f00) 00010000:00010000:3.0:1789065917.660206:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.660211:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.660217:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c83355 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065917.781225:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.782625:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235993856 00000100:00100000:2.0:1789065917.782639:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235993856 00000100:00100000:2.0:1789065917.782709:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 198 00000100:00100000:2.0:1789065917.782720:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+36:11570:x1875971235993856:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065917.782744:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065917.782765:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8336a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf59 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.782875:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.782890:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.782900:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.782913:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.782919:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.782942:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789065917.784343:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789065917.784526:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.784541:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.784580:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786276:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786293:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786301:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786307:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065917.786312:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786319:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786335:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065917.786339:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065917.786359:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786366:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83371 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065917.786384:0:5838:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000b57f1ad5 reply state 0000000011da0346 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065917.786394:0:5838:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789065917.786439:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8336a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 39 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 38 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.786462:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065917.786464:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065917.786466:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ce00, rc 0) 00000100:00100000:2.0:1789065917.786584:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b270000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+39:11570:x1875971235993856:12345-192.168.204.23@tcp:101:bash.0 Request processed in 3832us (5341us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1789065917.786592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 198 00010000:00010000:3.0:1789065917.790192:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.790212:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.790219:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.790225:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065917.790231:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.790239:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.790256:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065917.790259:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065917.790263:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065917.790286:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83378 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065917.792511:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.792765:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235993984 00000100:00100000:0.0:1789065917.792776:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235993984 00000100:00100000:0.0:1789065917.792831:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:0.0:1789065917.792841:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971235993984:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:0.0:1789065917.792862:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065917.792885:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf60 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789065917.792915:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789065917.792938:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=376s v=(0 0) 00010000:00010000:0.0:1789065917.792942:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065917.792951:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.792981:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.793002:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049800, rc 0) 00000100:00100000:0.0:1789065917.793070:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b272680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2349:x1875971235993984:12345-192.168.204.23@tcp:101:bash.0 Request processed in 230us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065917.793076:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:1.0:1789065917.798982:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.799921:0:6685:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235994112 00000100:00100000:2.0:1789065917.799936:0:6685:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235994112 00000100:00100000:2.0:1789065917.800326:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1789065917.800339:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:11570:x1875971235994112:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065917.800357:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065917.800379:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf67 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.800436:0:6685:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.800444:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065917.800447:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065917.800453:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.800487:0:6685:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.800500:0:6685:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065917.800513:0:6685:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875971258007552:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065917.800655:0:6685:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b2203c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065917.805786:0:6685:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6685:1875971258007552:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065917.805824:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 7 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065917.805847:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c800, rc 0) 00000100:00100000:2.0:1789065917.805907:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b271500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:11570:x1875971235994112:12345-192.168.204.23@tcp:101:bash.0 Request processed in 5572us (6935us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065917.805916:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1789065917.807363:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065917.809387:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235994240 00000100:00100000:0.0:1789065917.809404:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235994240 00010000:00010000:0.0:1789065917.809457:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065917.809772:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1789065917.809784:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2347:x1875971235994240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065917.809803:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065917.809829:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.809844:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.809871:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c8338d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf60 expref: 7 pid: 6688 timeout: 476 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.809887:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789065917.809892:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065917.809900:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.809910:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065917.809947:0:5823:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065917.809962:0:5823:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b274a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1875971258007680:192.168.204.23@tcp:105: 00000100:00100000:0.0:1789065917.810378:0:5823:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73840 going to sleep for 11 seconds 00000100:00100000:0.0:1789065917.823439:0:5823:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b274a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5823:1875971258007680:192.168.204.23@tcp:105: 00010000:00010000:0.0:1789065917.823468:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065917.823526:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2347:x1875971235994240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 13744us (16169us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065917.823537:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1789065917.830759:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065917.831428:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235994496 00000100:00100000:2.0:1789065917.831441:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235994496 00000100:00100000:2.0:1789065917.831513:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:2.0:1789065917.831523:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+38:11570:x1875971235994496:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:2.0:1789065917.831943:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+39:11570:x1875971235994496:12345-192.168.204.23@tcp:35:bash.0 Request processed in 421us (1193us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1789065917.831951:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 55 00000100:00100000:3.0:1789065918.085307:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.085942:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235994624 00000100:00100000:2.0:1789065918.085956:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235994624 00000100:00100000:2.0:1789065918.086028:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00100000:2.0:1789065918.086040:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+39:11586:x1875971235994624:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.086064:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.086086:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8339b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf6e expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.086180:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c833a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.086194:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c833a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.086207:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c833a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065918.086239:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789065918.086243:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065918.086261:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c833a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.086285:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c8339b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf6e expref: 41 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.086323:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c833a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf6e expref: 40 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.086332:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065918.086335:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065918.086338:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c600, rc 0) 00000100:00100000:2.0:1789065918.086405:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+40:11586:x1875971235994624:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 368us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.086412:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 199 00000100:00100000:1.0:1789065918.095254:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.095417:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235994880 00000100:00100000:3.0:1789065918.095428:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235994880 00000100:00100000:3.0:1789065918.095632:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00100000:3.0:1789065918.095644:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+40:11586:x1875971235994880:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065918.095665:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065918.095688:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c833a9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf75 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.095807:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c833b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.095821:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c833b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.095833:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c833b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065918.095845:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789065918.095971:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c833a9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf75 expref: 43 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.095988:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c833b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf75 expref: 42 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.096027:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:3.0:1789065918.096030:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065918.096034:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654c00, rc 0) 00000100:00100000:3.0:1789065918.096241:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b271c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+42:11586:x1875971235994880:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 598us (995us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789065918.096249:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00100000:0.0:1789065918.107887:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065918.107990:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.108307:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235995136 00000100:00100000:2.0:1789065918.108317:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235995136 00000100:00100000:2.0:1789065918.108378:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:2.0:1789065918.108388:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+42:11586:x1875971235995136:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.108411:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.108433:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c833be lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf7c expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.108569:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833c5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.108585:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.108596:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833c5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065918.108609:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789065918.108748:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c833be lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf7c expref: 45 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.108767:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf7c expref: 44 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.108776:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065918.108779:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789065918.108784:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065918.108851:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf073e63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+44:11586:x1875971235995136:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 464us (860us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789065918.108859:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 201 00000100:00100000:3.0:1789065918.113967:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235995264 00000100:00100000:3.0:1789065918.113981:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235995264 00000100:00100000:3.0:1789065918.114336:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1789065918.114349:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+44:2347:x1875971235995264:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065918.114368:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065918.114392:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c833b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf75 expref: 44 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.114408:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:3.0:1789065918.114413:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065918.115027:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+43:2347:x1875971235995264:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 674us (7142us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.115037:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1789065918.133669:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.133806:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235995392 00000100:00100000:2.0:1789065918.133818:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235995392 00000100:00100000:2.0:1789065918.133899:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:2.0:1789065918.133911:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+6:2348:x1875971235995392:12345-192.168.204.23@tcp:1:lfs.0 00010000:00010000:2.0:1789065918.133956:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.133977:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.133987:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789065918.133991:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789065918.133995:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.134044:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 6 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.134070:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 6 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.134097:0:6688:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875971258007808:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065918.134192:0:6688:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b2203c0 going to sleep for 11 seconds 00000100:00080000:3.0:1789065918.134438:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789065918.140999:0:6688:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6688:1875971258007808:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065918.141046:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065918.142123:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.142358:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235995520 00000100:00100000:3.0:1789065918.142367:0:6692:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235995520 00002000:00100000:3.0:1789065918.142417:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cf07f6bca80 x1875971235995520/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:564/0 lens 504/0 e 0 to 0 dl 1789065929 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789065918.142427:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07f6bca80 with x1875971235995520 ext(0->8) 00010000:00010000:3.0:1789065918.142452:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 7 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.142468:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 7 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065918.142477:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf07f6bca80 00000100:00100000:3.0:1789065918.142510:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:3.0:1789065918.142519:0:6692:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971235995520:12345-192.168.204.23@tcp:4:lfs.0 00000100:00100000:3.0:1789065918.143297:0:6692:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2349:x1875971235995520:12345-192.168.204.23@tcp:4:lfs.0 Request processed in 774us (1186us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789065918.143307:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00002000:00100000:3.0:1789065918.143315:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9cf07f6bca80 x1875971235995520/t4294967308(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:564/0 lens 504/448 e 0 to 0 dl 1789065929 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789065918.143325:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07f6bca80 with x1875971235995520 ext(0->8) 00010000:00010000:3.0:1789065918.143331:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.143344:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789065918.143352:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff9cf07f6bca80 00000100:00100000:1.0:1789065918.146458:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.147120:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235995648 00000100:00100000:3.0:1789065918.147131:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235995648 00010000:00010000:3.0:1789065918.147173:0:5825:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065918.147233:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:3.0:1789065918.147242:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2350:x1875971235995648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065918.147258:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789065918.147277:0:5825:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789065918.147280:0:5825:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789065917 00002000:00010000:3.0:1789065918.147283:0:5825:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789065917 00002000:00010000:3.0:1789065918.147285:0:5825:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789065917 00010000:00010000:3.0:1789065918.147291:0:5825:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.147305:0:5825:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.147327:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcc0fcae/0x7555615576c83394 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf67 expref: 9 pid: 6685 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.147345:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065918.147350:0:5825:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065918.147357:0:5825:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.147368:0:5825:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.147402:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065918.147474:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c19b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2350:x1875971235995648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 232us (1026us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.147482:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00010000:00010000:2.0:1789065918.147638:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147649:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147673:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147681:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147688:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147707:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065918.147712:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147720:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147732:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.147739:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e90892ee/0x7555615576c833d3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.147798:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971235995392:12345-192.168.204.23@tcp:1:lfs.0 Request processed in 13890us (14138us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.147806:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:1.0:1789065918.154543:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.154661:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235995904 00000100:00100000:2.0:1789065918.154671:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235995904 00000100:00100000:2.0:1789065918.154723:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 56 00000100:00100000:2.0:1789065918.154733:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+43:11586:x1875971235995904:12345-192.168.204.23@tcp:35:lfs.0 00000004:00010000:2.0:1789065918.154820:0:5841:0:(mdt_open.c:1970:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833c5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf7c expref: 43 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065918.155095:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:2.0:1789065918.155156:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1789065918.155479:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:2.0:1789065918.155534:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.155574:0:5841:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.155584:0:5841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.155618:0:5841:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 47 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.155633:0:5841:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 47 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.155647:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1875971258007936:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065918.155735:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051a65a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789065918.163090:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5841:1875971258007936:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065918.163138:0:5841:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065918.163320:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.163414:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235996032 00000100:00100000:3.0:1789065918.163422:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235996032 00010000:00010000:3.0:1789065918.163459:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 48 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065918.163498:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:3.0:1789065918.163508:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+48:2348:x1875971235996032:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065918.163526:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065918.163534:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 48 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.163591:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 48 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.163615:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8337f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf59 expref: 48 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.163633:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:3.0:1789065918.163638:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.163647:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.163654:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.163694:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065918.163762:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b271f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+47:2348:x1875971235996032:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 254us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.163778:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00010000:00010000:0.0:1789065918.163845:0:5841:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.163853:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789065918.163997:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:0.0:1789065918.164203:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:0.0:1789065918.164306:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f6bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971258008064:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789065918.164360:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065918.164401:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73600 going to sleep for 11 seconds 00000100:00100000:3.0:1789065918.164600:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258008064 00000100:00100000:3.0:1789065918.164606:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258008064 00000100:00100000:3.0:1789065918.164652:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789065918.164660:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875971258008064:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1789065918.164729:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875971258008064:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 69us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.164736:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1789065918.164756:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065918.165589:0:5841:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:0.0:1789065918.165598:0:5841:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:0.0:1789065918.165620:0:5841:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf0508f8000, transno 4294967307 00000100:00100000:0.0:1789065918.165638:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f6bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971258008064:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1789065918.169890:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1789065918.169998:0:5841:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f6bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971258008192:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789065918.170070:0:5841:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065918.170273:0:5841:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf073e73840 going to sleep for 11 seconds 00000100:00100000:1.0:1789065918.170467:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258008192 00000100:00100000:1.0:1789065918.170477:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258008192 00000100:00100000:1.0:1789065918.170541:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789065918.170589:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5841:x1875971258008192:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789065918.170803:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5841:x1875971258008192:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 253us (732us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789065918.170811:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789065918.171228:0:5841:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f6bce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5841:1875971258008192:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1789065918.171297:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1789065918.171345:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.171355:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.171374:0:5841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.171380:0:5841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.171386:0:5841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.171393:0:5841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.171409:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065918.171412:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789065918.171417:0:5841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.171424:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833da lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789065918.171652:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789065918.171744:0:5841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:2.0:1789065918.171754:0:5841:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 377365205505ns, next at 378365203200ns, rc = 0 00000001:00080000:2.0:1789065918.171760:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:2.0:1789065918.172003:0:5841:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065918.172007:0:5841:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789065918.172014:0:5841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833c5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf7c expref: 51 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.172249:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba5c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+50:11586:x1875971235995904:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 17517us (17716us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1789065918.172270:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 56 00000020:00080000:2.0:1789065918.172275:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1789065918.179017:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.179208:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235996160 00000100:00100000:2.0:1789065918.179218:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235996160 00000100:00100000:2.0:1789065918.179284:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 202 00000100:00100000:2.0:1789065918.179295:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+50:11586:x1875971235996160:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.179321:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.179347:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c833e1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf83 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.179411:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c833e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf83 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.179426:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c833e1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf83 expref: 51 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.179444:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.179447:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065918.179450:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065918.179514:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b272d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+51:11586:x1875971235996160:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 221us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.179521:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 202 00000100:00100000:1.0:1789065918.184039:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.184228:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235996416 00000100:00100000:3.0:1789065918.184242:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235996416 00000100:00100000:3.0:1789065918.184308:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:3.0:1789065918.184320:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+51:11586:x1875971235996416:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1789065918.184599:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b272300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+52:11586:x1875971235996416:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 280us (582us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789065918.184606:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 57 00000100:00100000:1.0:1789065918.295231:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.295329:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235996544 00000100:00100000:2.0:1789065918.295340:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235996544 00000100:00100000:2.0:1789065918.295407:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:2.0:1789065918.295418:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+52:11596:x1875971235996544:12345-192.168.204.23@tcp:34:lfs.0 00010000:00010000:2.0:1789065918.295518:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295537:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295578:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295595:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295603:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295610:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295704:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295712:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295718:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065918.295760:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295792:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295807:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295813:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295819:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.295824:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295831:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295845:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065918.295848:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.295853:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295860:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c833e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295875:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295882:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295887:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295892:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.295901:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295907:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.295915:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065918.295918:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.295993:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296001:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c833ef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296017:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296022:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296028:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296033:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.296035:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296041:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296047:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.296049:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.296057:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.296062:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.296230:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b273480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+52:11596:x1875971235996544:12345-192.168.204.23@tcp:34:lfs.0 Request processed in 812us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.296238:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 203 00000100:00100000:1.0:1789065918.338995:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.339160:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235996800 00000100:00100000:2.0:1789065918.339170:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235996800 00000100:00100000:2.0:1789065918.339233:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 204 00000100:00100000:2.0:1789065918.339243:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+52:11599:x1875971235996800:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.339263:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.339284:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833fd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf8a expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339357:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339372:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339384:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339399:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339405:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339429:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339585:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339595:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339602:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065918.339613:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789065918.339708:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339716:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339723:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339728:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.339732:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339739:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339750:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065918.339753:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.339889:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339898:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339912:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339918:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339985:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339990:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.339993:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.339999:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.340007:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065918.340009:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.340011:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.340017:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8340b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.340055:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c833fd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf8a expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.340197:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf8a expref: 54 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.340205:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.340207:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065918.340210:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1da00, rc 0) 00000100:00100000:2.0:1789065918.340278:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b273100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+54:11599:x1875971235996800:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1037us (1294us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1789065918.340286:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 204 00000100:00100000:1.0:1789065918.345479:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065918.345593:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235996928 00000100:00100000:0.0:1789065918.345604:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235996928 00000100:00100000:0.0:1789065918.345658:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:0.0:1789065918.345668:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+54:11599:x1875971235996928:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1789065918.345768:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345787:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345800:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345828:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345835:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345842:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345848:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065918.345852:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345860:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345884:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065918.345887:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789065918.345892:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.345898:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c83420 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065918.346324:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b270700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+54:11599:x1875971235996928:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 655us (853us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065918.346333:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 205 00000100:00100000:1.0:1789065918.352290:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.352375:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235997184 00000100:00100000:3.0:1789065918.352386:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235997184 00000100:00100000:3.0:1789065918.352445:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 58 00000100:00100000:3.0:1789065918.352455:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+54:11599:x1875971235997184:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1789065918.352728:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b270a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+55:11599:x1875971235997184:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 273us (447us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1789065918.352749:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 58 00010000:00010000:2.0:1789065918.438822:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065918.483282:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.483441:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235997440 00000100:00100000:3.0:1789065918.483452:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235997440 00000100:00100000:3.0:1789065918.483516:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00100000:3.0:1789065918.483527:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+55:11610:x1875971235997440:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789065918.483578:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065918.483582:0:5840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789065918.483610:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c833a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf6e expref: 55 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.483629:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:3.0:1789065918.483634:0:5840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789065918.483646:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83427 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf91 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.483745:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8342e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.483760:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8342e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.483771:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8342e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065918.483782:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789065918.483921:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83427 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf91 expref: 57 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.483955:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8342e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf91 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.483963:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065918.483966:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789065918.483969:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655400, rc 0) 00000100:00100000:3.0:1789065918.484985:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b270380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+56:11610:x1875971235997440:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1447us (1698us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789065918.484996:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 206 00000100:00100000:1.0:1789065918.489797:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.489883:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235997696 00000100:00100000:2.0:1789065918.489894:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235997696 00000100:00100000:2.0:1789065918.489957:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 207 00000100:00100000:2.0:1789065918.489967:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+56:11610:x1875971235997696:12345-192.168.204.23@tcp:36:bash.0 00010000:00010000:2.0:1789065918.490060:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1789065918.490099:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c8342e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf91 expref: 56 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.490131:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf8a expref: 55 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.490142:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.490147:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065918.490341:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.490367:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.490377:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789065918.490426:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:2.0:1789065918.490451:0:8255:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000006b83cb66 reply state 000000001828c0e4 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.490461:0:8255:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065918.490585:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b271180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+57:11610:x1875971235997696:12345-192.168.204.23@tcp:36:bash.0 Request processed in 619us (798us total) trans 4294967501 rc 0/0 00000100:00100000:2.0:1789065918.490593:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 207 00000020:00080000:2.0:1789065918.490597:0:8255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789065918.491986:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.492002:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.492010:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.492016:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065918.492021:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.492029:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.492043:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065918.492046:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065918.492051:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.492069:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c8343c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065918.506244:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.506815:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235997824 00000100:00100000:2.0:1789065918.506827:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235997824 00000100:00100000:2.0:1789065918.506891:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:2.0:1789065918.506902:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+56:11610:x1875971235997824:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789065918.506926:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.506948:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83443 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf98 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.507052:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.507066:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.507089:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065918.507143:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789065918.507148:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065918.507168:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.507195:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83443 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 58 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.507215:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 57 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.507224:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.507227:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065918.507231:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065918.507304:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b273800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+57:11610:x1875971235997824:12345-192.168.204.23@tcp:101:bash.0 Request processed in 403us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.507311:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 208 00000100:00100000:1.0:1789065918.523639:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.524146:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235998080 00000100:00100000:3.0:1789065918.524159:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235998080 00000100:00100000:3.0:1789065918.524229:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:3.0:1789065918.524242:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+57:11610:x1875971235998080:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:3.0:1789065918.524504:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b273b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+58:11610:x1875971235998080:12345-192.168.204.23@tcp:35:bash.0 Request processed in 263us (1033us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1789065918.524512:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 59 00000100:00100000:1.0:1789065918.593090:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.593191:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235998208 00000100:00100000:2.0:1789065918.593202:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235998208 00000100:00100000:2.0:1789065918.593277:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:2.0:1789065918.593289:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+58:11616:x1875971235998208:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.593314:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.593336:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83451 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdf9f expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.593402:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83458 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.593428:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.593441:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065918.593489:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789065918.593502:0:8255:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065918.593520:0:8255:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83458 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.593571:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83451 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf9f expref: 60 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.593591:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83458 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf9f expref: 59 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.593599:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065918.593602:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789065918.593606:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1de00, rc 0) 00000100:00100000:2.0:1789065918.593671:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b278380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235998208:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 383us (588us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.593678:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 209 00000100:00100000:1.0:1789065918.598128:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.598212:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235998336 00000100:00100000:2.0:1789065918.598223:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235998336 00000100:00100000:2.0:1789065918.598284:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:2.0:1789065918.598295:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235998336:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.598316:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.598360:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8345f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfa6 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598430:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598445:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598456:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598470:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598476:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598481:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598606:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598616:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598624:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065918.598660:0:5838:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789065918.598665:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065918.598683:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598702:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598711:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598718:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598725:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598730:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.598734:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598741:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598751:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065918.598754:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.598759:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598765:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c83466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598777:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598783:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598795:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598800:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065918.598803:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598809:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598816:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065918.598819:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065918.598822:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598943:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c8346d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598977:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8345f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfa6 expref: 61 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598990:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfa6 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.598996:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.598998:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065918.599001:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ce00, rc 0) 00000100:00100000:2.0:1789065918.599478:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11616:x1875971235998336:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1182us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.599495:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 210 00000100:00100000:1.0:1789065918.607477:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.607753:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235998464 00000100:00100000:3.0:1789065918.607764:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235998464 00000100:00100000:3.0:1789065918.607829:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1789065918.607840:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+60:2348:x1875971235998464:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065918.607857:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065918.607882:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c83474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfa6 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.607903:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065918.607907:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789065918.607965:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b279180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+59:2348:x1875971235998464:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 127us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.607973:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:1.0:1789065918.611437:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065918.611539:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235998720 00000100:00100000:2.0:1789065918.611587:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235998720 00000100:00100000:2.0:1789065918.611650:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:2.0:1789065918.611661:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235998720:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065918.611684:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065918.611707:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8347b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfad expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.611813:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.611838:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.611849:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.611884:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.611898:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 60 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065918.611911:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258008320:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065918.612004:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051a65b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789065918.615081:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc73b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258008320:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065918.615145:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065918.619770:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.622363:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235998848 00000100:00100000:3.0:1789065918.622379:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235998848 00010000:00010000:3.0:1789065918.622428:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 61 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065918.622668:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:3.0:1789065918.622678:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+61:2347:x1875971235998848:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789065918.622694:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789065918.622701:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 61 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.622714:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 61 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.622735:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c8344a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf98 expref: 61 pid: 5838 timeout: 477 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.622752:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065918.622757:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.622766:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.622774:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.622799:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065918.623429:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.623440:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065918.623460:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789065918.623641:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c8347b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 62 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.623661:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 61 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065918.623668:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065918.623671:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789065918.623674:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c600, rc 0) 00000100:00100000:3.0:1789065918.623787:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+61:2347:x1875971235998848:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 1108us (4025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.623797:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:0.0:1789065918.632307:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b279880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11616:x1875971235998720:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 20636us (20869us total) trans 4294967503 rc 0/0 00000100:00100000:0.0:1789065918.632339:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 211 00000100:00100000:1.0:1789065918.641714:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.642762:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235999104 00000100:00100000:3.0:1789065918.642938:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235999104 00000100:00100000:3.0:1789065918.648201:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1789065918.648437:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11616:x1875971235999104:12345-192.168.204.23@tcp:103:lfs.0 00010000:00010000:2.0:1789065918.648462:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065918.648492:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c833e1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf83 expref: 60 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065918.648511:0:5825:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065918.648528:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065918.648664:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235999104:12345-192.168.204.23@tcp:103:lfs.0 Request processed in 447us (6958us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065918.654452:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:1.0:1789065918.655446:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.655522:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235999232 00000100:00100000:3.0:1789065918.655531:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235999232 00000100:00100000:3.0:1789065918.655602:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:3.0:1789065918.655611:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235999232:12345-192.168.204.23@tcp:58:lfs.0 00010000:00010000:3.0:1789065918.655713:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.655730:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.655741:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789065918.655941:0:5840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789065918.656033:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b278000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235999232:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 423us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.656041:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 212 00000100:00100000:1.0:1789065918.660244:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065918.660413:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235999360 00000100:00100000:3.0:1789065918.660422:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235999360 00000100:00100000:3.0:1789065918.660475:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 213 00000100:00100000:3.0:1789065918.660484:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+59:11616:x1875971235999360:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:3.0:1789065918.660502:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065918.660521:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfb4 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.660613:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.660642:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.660661:0:5839:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.660674:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.660687:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065918.660691:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789065918.660695:0:5839:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 60 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065918.660703:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654400, rc 0) 00000100:00100000:3.0:1789065918.660755:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11616:x1875971235999360:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 272us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065918.660762:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 213 00000040:00080000:3.0:1789065919.461986:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065919.461998:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789065919.462034:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1789065919.462042:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789065919.463955:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258008448:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789065919.464149:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98300 going to sleep for 11 seconds 00010000:00010000:3.0:1789065919.465240:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065919.478432:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50dc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258008448:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789065919.479080:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.479250:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235999488 00000100:00100000:2.0:1789065919.479260:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235999488 00000100:00100000:2.0:1789065919.479335:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00100000:2.0:1789065919.479348:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11617:x1875971235999488:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789065919.479379:0:5838:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789065919.479596:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b279500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11617:x1875971235999488:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 250us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.479605:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 214 00000100:00080000:3.0:1789065919.480411:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065919.497145:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.497600:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235999616 00000100:00100000:3.0:1789065919.497612:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235999616 00000100:00100000:3.0:1789065919.497660:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:3.0:1789065919.497673:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11617:x1875971235999616:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.497769:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497789:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497802:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497818:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497825:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497832:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497858:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497866:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497872:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065919.497932:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789065919.497936:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065919.497965:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497977:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497984:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497990:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.497996:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065919.498001:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498009:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498022:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:3.0:1789065919.498025:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065919.498031:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498036:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c8349e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498051:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498066:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498072:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498077:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065919.498080:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498098:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498106:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9cf043e52400) 00010000:00010000:3.0:1789065919.498109:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065919.498112:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498118:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834a5 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498133:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498139:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498144:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498149:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065919.498158:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498164:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498172:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065919.498174:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065919.498177:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.498182:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834ac lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065919.498271:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b279c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11617:x1875971235999616:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 599us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.498280:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 215 00000100:00100000:1.0:1789065919.507811:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.507903:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971235999872 00000100:00100000:3.0:1789065919.507915:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971235999872 00000100:00100000:3.0:1789065919.507981:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:3.0:1789065919.507992:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+60:11617:x1875971235999872:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.508014:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065919.508035:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834b3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfbb expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508143:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508173:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508204:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065919.508217:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789065919.508324:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508332:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508339:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508346:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065919.508350:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508357:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508369:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:3.0:1789065919.508372:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789065919.508378:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508383:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834ba lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508425:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834b3 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfbb expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508446:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:3.0:1789065919.508852:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789065919.508858:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834b3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfbb expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.508869:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654200, rc 0) 00000100:00100000:3.0:1789065919.508935:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b279f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+61:11617:x1875971235999872:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 944us (1133us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1789065919.508943:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 216 00000100:00100000:1.0:1789065919.518005:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.529115:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236000000 00000100:00100000:3.0:1789065919.529132:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236000000 00000100:00100000:2.0:1789065919.529532:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:2.0:1789065919.529567:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+61:11617:x1875971236000000:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789065919.529609:0:5839:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789065919.529750:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+61:11617:x1875971236000000:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 207us (11754us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.529771:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 217 00000100:00100000:1.0:1789065919.536610:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.537081:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236000256 00000100:00100000:2.0:1789065919.537102:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236000256 00000100:00100000:2.0:1789065919.537164:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:2.0:1789065919.537176:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+61:11617:x1875971236000256:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065919.537197:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065919.537200:0:5838:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789065919.537229:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83458 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf9f expref: 61 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.537253:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065919.537259:0:5838:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065919.537272:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834c8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfc2 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789065919.537727:0:5838:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:2.0:1789065919.537925:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c834cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.537940:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c834cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.537951:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c834cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.538379:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834c8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc2 expref: 63 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.538420:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c834cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc2 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.538428:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789065919.538431:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065919.538433:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c200, rc 0) 00000100:00100000:2.0:1789065919.539158:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+62:11617:x1875971236000256:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1980us (2553us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1789065919.539170:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 218 00000100:00100000:1.0:1789065919.546870:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065919.548217:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236000512 00000100:00100000:0.0:1789065919.548233:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236000512 00000100:00100000:0.0:1789065919.548309:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 219 00000100:00100000:0.0:1789065919.548321:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+62:11617:x1875971236000512:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789065919.548382:0:8255:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065919.548408:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c200/0x7555615576c834cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc2 expref: 62 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548428:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:0.0:1789065919.548440:0:8255:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789065919.548474:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548488:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548499:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548513:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548520:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548526:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548627:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548634:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548641:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548646:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065919.548651:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548659:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548667:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:0.0:1789065919.548670:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065919.548674:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548678:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c834dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548687:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548692:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548697:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548710:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065919.548713:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548719:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548726:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x30588974 (ffff9cf043eb1e00) 00010000:00010000:0.0:1789065919.548729:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789065919.548732:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.548738:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048000/0x7555615576c834e4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x30588974 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.548831:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+61:11617:x1875971236000512:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 511us (1970us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789065919.548838:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 219 00000100:00100000:1.0:1789065919.554074:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.554393:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236000640 00000100:00100000:3.0:1789065919.554408:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236000640 00000100:00100000:3.0:1789065919.555310:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:3.0:1789065919.555323:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+61:11617:x1875971236000640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.555346:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065919.555374:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfc9 expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.555407:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.555420:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.555446:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.555581:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c834eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 63 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.555598:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 62 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.555606:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065919.555609:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789065919.555612:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655000, rc 0) 00000100:00100000:3.0:1789065919.555676:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b27b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+62:11617:x1875971236000640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 356us (1611us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.555683:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 220 00000100:00100000:1.0:1789065919.562359:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.562911:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236000896 00000100:00100000:3.0:1789065919.562923:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236000896 00000100:00100000:2.0:1789065919.563078:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 221 00000100:00100000:2.0:1789065919.563103:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+62:11617:x1875971236000896:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789065919.563193:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.563209:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.563222:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789065919.563747:0:5839:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:2.0:1789065919.563760:0:5839:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 378757210912ns, next at 379757208402ns, rc = 0 00000004:00010000:2.0:1789065919.563861:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000035dd4215 reply state 00000000e0febd49 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.563871:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065919.563990:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b278700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+64:11617:x1875971236000896:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 891us (1640us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1789065919.563998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 221 00010000:00010000:3.0:1789065919.567792:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.567815:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.567823:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.567830:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065919.567835:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.567844:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.567883:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065919.567886:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789065919.567892:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.567898:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c834f9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065919.570049:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.570174:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236001024 00000100:00100000:3.0:1789065919.570189:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236001024 00000100:00100000:3.0:1789065919.570267:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:3.0:1789065919.570280:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+63:11617:x1875971236001024:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.570314:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065919.570339:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfd0 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.570436:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.570455:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 64 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.570477:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065919.570481:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789065919.570486:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654200, rc 0) 00000100:00100000:3.0:1789065919.570595:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b278a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+64:11617:x1875971236001024:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 317us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.570620:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 222 00000100:00100000:1.0:1789065919.576071:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.576334:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236001152 00000100:00100000:2.0:1789065919.576348:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236001152 00000100:00100000:2.0:1789065919.576443:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:2.0:1789065919.576456:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2348:x1875971236001152:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789065919.576868:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b278e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2348:x1875971236001152:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 414us (816us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1789065919.576876:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00080000:3.0:1789065919.577458:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789065919.580728:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.580830:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236001408 00000100:00100000:2.0:1789065919.580844:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236001408 00000100:00100000:2.0:1789065919.580905:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:2.0:1789065919.580915:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+64:11617:x1875971236001408:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789065919.581210:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+65:11617:x1875971236001408:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 294us (489us total) trans 4294967507 rc 0/0 00000100:00100000:2.0:1789065919.581217:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 60 00000100:00100000:0.0:1789065919.588414:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.588853:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236001664 00000100:00100000:2.0:1789065919.588865:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236001664 00000100:00100000:2.0:1789065919.588933:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:2.0:1789065919.588944:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+65:11617:x1875971236001664:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789065919.589344:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+65:11617:x1875971236001664:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 401us (939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.589353:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 223 00000100:00100000:1.0:1789065919.596294:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.596920:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236001792 00000100:00100000:3.0:1789065919.596937:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236001792 00000100:00100000:3.0:1789065919.597013:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:3.0:1789065919.597023:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+65:11617:x1875971236001792:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.597046:0:5838:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065919.597079:0:5838:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfd7 expref: -99 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.597159:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c8350e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.597173:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c8350e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.597185:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c8350e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065919.597222:0:5838:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065919.597241:0:5838:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c8350e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.597270:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd7 expref: 67 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.597289:0:5838:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c8350e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd7 expref: 66 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.597313:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065919.597316:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789065919.597320:0:5838:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655e00, rc 0) 00000100:00100000:3.0:1789065919.597391:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+66:11617:x1875971236001792:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 369us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.597399:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 224 00000100:00100000:1.0:1789065919.601658:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065919.601829:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236001920 00000100:00100000:0.0:1789065919.601843:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236001920 00000100:00100000:0.0:1789065919.601905:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:0.0:1789065919.601916:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+10:2347:x1875971236001920:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789065919.601942:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065919.601969:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfde expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789065919.602036:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2fabe, blocks: 0x1 00010000:00010000:0.0:1789065919.602071:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1789065919.602077:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789065919.602096:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.602118:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.602133:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049e00, rc 0) 00000100:00100000:0.0:1789065919.602213:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058087c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+11:2347:x1875971236001920:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 297us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065919.602220:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:0.0:1789065919.612806:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.612890:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002176 00000100:00100000:2.0:1789065919.612916:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002176 00000100:00100000:2.0:1789065919.612987:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 225 00000100:00100000:2.0:1789065919.613008:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+66:11617:x1875971236002176:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789065919.613155:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+66:11617:x1875971236002176:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 148us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.613163:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 225 00000100:00100000:2.0:1789065919.622791:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065919.622963:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002304 00000100:00100000:1.0:1789065919.622977:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002304 00000100:00100000:1.0:1789065919.623163:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:1.0:1789065919.623177:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+11:11617:x1875971236002304:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789065919.623203:0:6880:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065919.623238:0:6880:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfe5 expref: -99 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.623274:0:6880:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.623283:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065919.623288:0:6880:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065919.623294:0:6880:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 12 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.623328:0:6880:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.623354:0:6880:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 12 pid: 6687 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065919.623371:0:6880:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6880:1875971258008576:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065919.623466:0:6880:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f5616c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065919.629862:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065919.630756:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002432 00000100:00100000:2.0:1789065919.630773:0:6880:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:6880:1875971258008576:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789065919.630775:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002432 00010000:00010000:2.0:1789065919.630810:0:6880:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 13 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.630815:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 13 pid: 6687 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.630832:0:6880:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6c00, rc 0) 00000100:00100000:1.0:1789065919.630856:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:1.0:1789065919.630865:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+13:2347:x1875971236002432:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065919.630879:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1789065919.630889:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc73b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+13:11617:x1875971236002304:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 7717us (8112us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.630896:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00010000:00010000:1.0:1789065919.630901:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 13 pid: 6687 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.630914:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 12 pid: 6687 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.630938:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f88c7c/0x7555615576c83515 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfde expref: 12 pid: 6687 timeout: 478 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.630953:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065919.630957:0:5824:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789065919.630966:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 11 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.630975:0:5824:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 11 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.631203:0:5824:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 11 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065919.631234:0:5824:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1875971258008704:192.168.204.23@tcp:105: 00000100:00100000:1.0:1789065919.631287:0:5824:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f561600 going to sleep for 11 seconds 00000100:00100000:2.0:1789065919.637180:0:5824:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5824:1875971258008704:192.168.204.23@tcp:105: 00010000:00010000:2.0:1789065919.637222:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065919.637306:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+11:2347:x1875971236002432:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 6440us (7453us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.637319:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:0.0:1789065919.656239:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.656335:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002560 00000100:00100000:2.0:1789065919.656355:0:6691:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002560 00002000:00100000:2.0:1789065919.656408:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9cf07f6bea00 x1875971236002560/t0(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:565/0 lens 504/0 e 0 to 0 dl 1789065930 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789065919.656419:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07f6bea00 with x1875971236002560 ext(0->12) 00002000:00010000:2.0:1789065919.656440:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07f6bea00 00000100:00100000:2.0:1789065919.656475:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:2.0:1789065919.656485:0:6691:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+11:2350:x1875971236002560:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789065919.657248:0:6691:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+13:2350:x1875971236002560:12345-192.168.204.23@tcp:4:lhsmtool_posix.0 Request processed in 758us (1012us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1789065919.657259:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00002000:00100000:0.0:1789065919.657267:0:6691:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff9cf07f6bea00 x1875971236002560/t4294967321(0) o4->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:565/0 lens 504/448 e 0 to 0 dl 1789065930 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065919.657276:0:6691:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07f6bea00 with x1875971236002560 ext(0->12) 00002000:00010000:0.0:1789065919.657281:0:6691:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07f6bea00 00000100:00100000:1.0:1789065919.660673:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.660768:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002688 00000100:00100000:3.0:1789065919.660779:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002688 00000100:00100000:3.0:1789065919.660839:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 226 00000100:00100000:3.0:1789065919.660849:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+66:11617:x1875971236002688:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789065919.711739:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967503 is committed 00000020:00080000:3.0:1789065919.711762:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf073e73600 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1789065919.711769:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07ae6fd00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf073e73e40 00000020:00080000:3.0:1789065919.711773:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07ae6f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf07edb7400 00000004:00080000:3.0:1789065919.711800:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000001:00080000:3.0:1789065919.711826:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:3.0:1789065919.711832:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:3.0:1789065919.711844:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:3.0:1789065919.711877:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf042ce0e40 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1789065919.711879:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf07ecbdb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf042ce0a80 00000020:00080000:3.0:1789065919.711882:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf06063ed00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf07fc75400 00000100:00100000:3.0:1789065919.712440:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258008832:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789065919.712520:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065919.712630:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789065919.712636:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258008960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789065919.712661:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065919.712690:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258009088:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789065919.712713:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065919.712754:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258008832 00000100:00100000:3.0:1789065919.712762:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258008832 00000100:00100000:3.0:1789065919.712814:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258008960 00000100:00100000:3.0:1789065919.712818:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258008960 00000100:00100000:3.0:1789065919.712829:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258009088 00000100:00100000:3.0:1789065919.712832:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258009088 00000100:00100000:3.0:1789065919.712847:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789065919.712855:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258008832:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789065919.712882:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1789065919.713285:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713311:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713319:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:3.0:1789065919.713324:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065919.713328:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713362:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 12 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713392:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 12 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065919.713406:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875971258009216:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065919.713473:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789065919.713497:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789065919.713505:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258008960:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1789065919.713686:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789065919.713690:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789065918 00002000:00010000:3.0:1789065919.713692:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789065919.713694:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789065918 -> 1789065918 00002000:00010000:3.0:1789065919.713697:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789065919.713740:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058047480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3295:x1875971258008960:12345-0@lo:2:osp-syn-0-0.0 Request processed in 236us (1078us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1789065919.713747:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789065919.713767:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789065919.713773:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258009088:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1789065919.713787:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00002000:00010000:3.0:1789065919.713811:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa2fabd, atime: 0x6aa2fabd, ctime: 0x6aa2fabd, blocks: 0x1 00010000:00010000:3.0:1789065919.713817:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713825:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=378s v=(0 0) 00010000:00010000:3.0:1789065919.713829:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065919.713842:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713857:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713866:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713873:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.713890:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:0.0:1789065919.714161:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789065919.714308:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1789065919.716950:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971258009088:12345-0@lo:6:osp-syn-1-0.0 Request processed in 3170us (4229us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789065919.716963:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1789065919.717004:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789065919.717232:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065919.717241:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.717255:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065919.717260:0:6701:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.717270:0:6701:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.717307:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.717315:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c8352a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.717338:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065919.717340:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065919.717342:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789065919.717385:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07f50d880/2, rc 0, transno 4294967322 00000100:00100000:3.0:1789065919.717392:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258008960:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1789065919.717499:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11617:x1875971236002688:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 56649us (56833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.717509:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 226 00000004:00080000:0.0:1789065919.717855:0:3297:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07f50f480/2, rc 0, transno 4294967310 00000100:00100000:0.0:1789065919.717861:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258009088:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789065919.723055:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.724589:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002816 00000100:00100000:3.0:1789065919.724607:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002816 00000100:00100000:3.0:1789065919.724729:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:3.0:1789065919.724741:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+13:2348:x1875971236002816:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1789065919.729975:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065919.730011:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236002944 00000100:00100000:0.0:1789065919.730021:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236002944 00010000:00010000:0.0:1789065919.730067:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 14 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.730128:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:0.0:1789065919.730138:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971236002944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065919.730153:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065919.730159:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 14 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.730173:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 14 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.730198:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789065919.730203:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789065919.730209:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.730219:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.730254:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065919.730308:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+14:2347:x1875971236002944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 171us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065919.730316:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00010000:00010000:3.0:1789065919.731190:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c832e5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf44 expref: 13 pid: 6685 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065919.731210:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875971258009216:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065919.731233:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.731260:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.731267:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.731277:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.731286:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.731307:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789065919.731954:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058044000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3295:x1875971258008832:12345-0@lo:6:osp-syn-0-0.0 Request processed in 19096us (19431us total) trans 4294967323 rc 0/0 00000100:00100000:3.0:1789065919.731964:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00010000:2.0:1789065919.734172:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065919.734187:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.734201:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789065919.734207:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.734218:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.734244:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.734253:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c83523 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.734280:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065919.734282:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065919.734284:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789065919.736622:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07f50dc00/2, rc 0, transno 4294967323 00000100:00100000:2.0:1789065919.736640:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258008832:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789065919.760715:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:0.0:1789065919.760740:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967318 is committed 00000001:00080000:0.0:1789065919.760754:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000100:00100000:3.0:1789065919.761535:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971236002816:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 36788us (38486us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.761909:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:0.0:1789065919.765102:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.765678:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236003200 00000100:00100000:2.0:1789065919.765703:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236003200 00000100:00100000:2.0:1789065919.765805:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 227 00000100:00100000:2.0:1789065919.765817:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11617:x1875971236003200:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789065919.765873:0:5839:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065919.765904:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c8350e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd7 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.765925:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:2.0:1789065919.765931:0:5839:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789065919.765966:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.765981:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.765993:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789065919.766252:0:5839:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000b00578eb reply state 0000000074056a0d transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.766263:0:5839:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789065919.766423:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+21:11617:x1875971236003200:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 604us (1340us total) trans 4294967508 rc 0/0 00000100:00100000:2.0:1789065919.766432:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 227 00010000:00010000:3.0:1789065919.770659:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.770678:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.770686:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.770708:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789065919.770713:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.770720:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.770737:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:3.0:1789065919.770740:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789065919.770746:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.770752:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83531 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.774928:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.775202:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236003328 00000100:00100000:3.0:1789065919.775317:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236003328 00000100:00100000:0.0:1789065919.775859:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:0.0:1789065919.775874:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971236003328:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789065919.776477:0:6685:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789065919.776483:0:6685:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1789065918 -> 1789065917 00002000:00010000:0.0:1789065919.776485:0:6685:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789065917 00002000:00010000:0.0:1789065919.776487:0:6685:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1789065918 -> 1789065917 00002000:00010000:0.0:1789065919.776489:0:6685:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1789065919.777185:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2349:x1875971236003328:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 1309us (2259us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1789065919.777196:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 70 00000100:00100000:1.0:1789065919.780015:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.780178:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236003584 00000100:00100000:3.0:1789065919.780189:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236003584 00000100:00100000:3.0:1789065919.780345:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 228 00000100:00100000:3.0:1789065919.780355:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+20:11617:x1875971236003584:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.780427:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.780447:0:5840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.780458:0:5840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.780510:0:5840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.780524:0:5840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 20 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065919.780537:0:5840:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258009344:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065919.781851:0:5840:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98300 going to sleep for 11 seconds 00000100:00100000:1.0:1789065919.787722:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065919.787893:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236003712 00000100:00100000:0.0:1789065919.787905:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236003712 00010000:00010000:0.0:1789065919.787949:0:8446:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 21 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.788003:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:0.0:1789065919.788032:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+21:2348:x1875971236003712:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789065919.788124:0:8446:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065919.788133:0:8446:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 21 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.788147:0:8446:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 21 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.788171:0:8446:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:0.0:1789065919.788177:0:8446:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.788187:0:8446:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.788196:0:8446:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.788650:0:8446:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065919.788751:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c19b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+21:2348:x1875971236003712:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 724us (1038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065919.788760:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00010000:00010000:3.0:1789065919.789534:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c834f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfc9 expref: 20 pid: 5840 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065919.789583:0:5840:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5840:1875971258009344:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065919.789607:0:5840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790441:0:5840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790454:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790504:0:5840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790512:0:5840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790519:0:5840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790524:0:5840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.790529:0:5840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790536:0:5840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790568:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:2.0:1789065919.790571:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1789065919.790576:0:5840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.790581:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655200/0x7555615576c83538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.790645:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11617:x1875971236003584:12345-192.168.204.23@tcp:55:lhsmtool_posix.0 Request processed in 10289us (10639us total) trans 0 rc -22/-22 00000100:00100000:2.0:1789065919.790655:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 228 00000100:00100000:0.0:1789065919.793172:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.793317:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236003840 00000100:00100000:3.0:1789065919.793328:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236003840 00000100:00100000:3.0:1789065919.793428:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:3.0:1789065919.793439:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2348:x1875971236003840:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1789065919.793487:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.793507:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.793516:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065919.793533:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789065919.793538:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.793600:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 8 pid: 6880 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.793615:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 8 pid: 6880 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065919.793632:0:6687:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875971258009472:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789065919.793713:0:6687:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98300 going to sleep for 11 seconds 00000100:00100000:3.0:1789065919.797056:0:6687:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6687:1875971258009472:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789065919.797096:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.798898:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065919.799412:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236003968 00000100:00100000:1.0:1789065919.799422:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236003968 00010000:00010000:1.0:1789065919.799467:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 9 pid: 6880 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065919.799512:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:1.0:1789065919.799522:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+9:2347:x1875971236003968:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065919.799538:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065919.799603:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 9 pid: 6880 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.799617:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 9 pid: 6880 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.799640:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b1f73341/0x7555615576c8351c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfe5 expref: 9 pid: 6880 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.799656:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789065919.799671:0:5823:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789065919.799676:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.799686:0:5823:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.799710:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065919.799763:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971236003968:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 242us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065919.799771:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00010000:00010000:0.0:1789065919.799945:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.799955:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800004:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800014:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800022:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800030:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065919.800035:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800050:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800064:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.800071:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097aa156c/0x7555615576c8353f lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.800144:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2348:x1875971236003840:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 6707us (6982us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065919.800152:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 71 00000100:00100000:0.0:1789065919.806151:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.806241:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236004224 00000100:00100000:2.0:1789065919.806253:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236004224 00000100:00100000:2.0:1789065919.806316:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 229 00000100:00100000:2.0:1789065919.806343:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11617:x1875971236004224:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789065919.806438:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806458:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806472:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806729:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806742:0:8255:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806750:0:8255:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806786:0:8255:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 20 pid: 5838 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.806802:0:8255:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 20 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.806818:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258009600:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065919.806911:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d600 going to sleep for 11 seconds 00000100:00100000:2.0:1789065919.812630:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc71180 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258009600:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065919.812663:0:8255:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.813973:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.814241:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236004352 00000100:00100000:2.0:1789065919.814253:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236004352 00010000:00010000:2.0:1789065919.814299:0:5824:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 21 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.814342:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:2.0:1789065919.814352:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+21:2348:x1875971236004352:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065919.814369:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065919.814375:0:5824:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 21 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.814389:0:5824:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 21 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.814413:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654200/0x7555615576c83500 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfd0 expref: 21 pid: 5838 timeout: 478 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.814430:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:2.0:1789065919.814435:0:5824:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.814444:0:5824:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.814450:0:5824:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.814484:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065919.814683:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+20:2348:x1875971236004352:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 331us (716us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.814691:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00010000:00010000:3.0:1789065919.814801:0:8255:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.814810:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789065919.815005:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1789065919.815178:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1789065919.815241:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1789065919.815340:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971258009728:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789065919.815404:0:8255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065919.815456:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050f98180 going to sleep for 11 seconds 00000100:00100000:0.0:1789065919.815593:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258009728 00000100:00100000:0.0:1789065919.815600:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258009728 00000100:00100000:0.0:1789065919.815640:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789065919.815648:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8255:x1875971258009728:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789065919.815724:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8255:x1875971258009728:12345-0@lo:1000:mdt00_003.0 Request processed in 77us (319us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065919.815730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789065919.816192:0:8255:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967322 gen 2 00000004:00080000:2.0:1789065919.816199:0:8255:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967322 00000004:00080000:2.0:1789065919.816229:0:8255:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07f50d880, transno 4294967322 00000100:00100000:2.0:1789065919.816248:0:8255:0:(client.c:3170:ptlrpc_free_committed()) @@@ stopping search req@ffff9cf07f50dc00 x1875971258008832/t4294967323(4294967323) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789065935 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789065919.816260:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058046680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971258009728:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789065919.816779:0:8255:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:2.0:1789065919.816850:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971258009856:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789065919.816898:0:8255:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065919.817230:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf042ce0240 going to sleep for 11 seconds 00000100:00100000:0.0:1789065919.819530:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258009856 00000100:00100000:0.0:1789065919.819544:0:5844:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258009856 00000100:00100000:0.0:1789065919.822791:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789065919.822804:0:5844:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:8255:x1875971258009856:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789065919.823137:0:5844:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:8255:x1875971258009856:12345-0@lo:1000:mdt00_003.0 Request processed in 334us (6236us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1789065919.823145:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789065919.823261:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:8255:1875971258009856:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1789065919.823305:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823317:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823326:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823334:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.823339:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823347:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823378:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52400) 00010000:00010000:2.0:1789065919.823381:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065919.823387:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823394:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c8354d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823426:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823432:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823437:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823442:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.823445:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823450:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823457:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065919.823460:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789065919.823465:0:8255:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823476:0:8255:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823493:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.823527:0:8255:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 23 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.823541:0:8255:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258009984:192.168.204.23@tcp:105: 00000100:00100000:2.0:1789065919.823638:0:8255:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20a300 going to sleep for 11 seconds 00000100:00100000:0.0:1789065919.828635:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.828729:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236004480 00000100:00100000:3.0:1789065919.828740:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236004480 00000100:00100000:3.0:1789065919.828792:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:3.0:1789065919.828801:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11616:x1875971236004480:12345-192.168.204.23@tcp:49:lfs.0 00000100:00100000:3.0:1789065919.828931:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+24:11616:x1875971236004480:12345-192.168.204.23@tcp:49:lfs.0 Request processed in 130us (306us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065919.828938:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 61 00000100:00100000:2.0:1789065919.829060:0:8255:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc71880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:8255:1875971258009984:192.168.204.23@tcp:105: 00010000:00010000:2.0:1789065919.829095:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829105:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654c00/0x7555615576c83490 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829136:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829150:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829162:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829172:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829178:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829202:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829207:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.829211:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829219:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829231:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065919.829234:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065919.829239:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829244:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83554 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829255:0:8255:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829260:0:8255:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829265:0:8255:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829270:0:8255:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1da00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.829272:0:8255:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829285:0:8255:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829294:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065919.829296:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789065919.829298:0:8255:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.829303:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83546 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.829498:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+23:11617:x1875971236004224:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 23156us (23357us total) trans 4294967513 rc 0/0 00000100:00100000:2.0:1789065919.829508:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 229 00000020:00080000:2.0:1789065919.829513:0:8255:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789065919.829795:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789065919.829801:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789065919.830364:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789065919.830375:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789065919.835244:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065919.835288:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065919.835377:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236004736 00000100:00100000:3.0:1789065919.835390:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236004736 00000100:00100000:3.0:1789065919.835453:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 62 00000100:00100000:3.0:1789065919.835463:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+23:11617:x1875971236004736:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789065919.836367:0:5841:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789065919.836478:0:5841:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:3.0:1789065919.836529:0:5841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065919.836753:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236004992 00000100:00100000:1.0:1789065919.836760:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236004992 00010000:00010000:3.0:1789065919.836944:0:5841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.836960:0:5841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.836969:0:5841:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.836987:0:5841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.836994:0:5841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065919.837089:0:5841:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789065919.837190:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba7c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11617:x1875971236004736:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 1725us (1953us total) trans 4294967515 rc 0/0 00000100:00100000:0.0:1789065919.837200:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 62 00000020:00080000:0.0:1789065919.837205:0:5841:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789065919.837566:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 230 00000100:00100000:1.0:1789065919.837581:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11616:x1875971236004992:12345-192.168.204.23@tcp:58:lfs.0 00000040:00080000:1.0:1789065919.837781:0:5838:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1789065919.837842:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11616:x1875971236004992:12345-192.168.204.23@tcp:58:lfs.0 Request processed in 266us (2552us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065919.837849:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 230 00010000:00010000:3.0:1789065919.837953:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065919.837960:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.837968:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789065919.837972:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.837980:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.837993:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9cf043e52600) 00010000:00010000:3.0:1789065919.837996:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789065919.838001:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.838007:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c8355b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5841 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065919.838022:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065919.838023:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065919.838025:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065919.875365:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065919.875461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236005120 00000100:00100000:2.0:1789065919.875472:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236005120 00000100:00100000:2.0:1789065919.875542:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 231 00000100:00100000:2.0:1789065919.875585:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+25:11619:x1875971236005120:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789065919.875610:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065919.875633:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83562 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdfec expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.875713:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.875727:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.875746:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.875760:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.875873:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.875880:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.876313:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.876328:0:5839:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 26 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.876380:0:5839:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.876420:0:5839:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 26 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.876434:0:5839:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 26 pid: 8255 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789065919.876448:0:5839:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc71880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875971258010112:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789065919.876526:0:5839:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20a300 going to sleep for 11 seconds 00000100:00100000:1.0:1789065919.882702:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065919.883165:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236005376 00000100:00100000:0.0:1789065919.883176:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236005376 00000100:00100000:2.0:1789065919.883331:0:5839:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc71880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5839:1875971258010112:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789065919.883369:0:5839:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065919.884336:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:0.0:1789065919.884367:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+27:5591:x1875971236005376:12345-192.168.204.23@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1789065919.884631:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+28:5591:x1875971236005376:12345-192.168.204.23@tcp:35:ldlm_bl.0 Request processed in 268us (1940us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1789065919.884638:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 63 00000100:00100000:0.0:1789065919.887503:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065919.887917:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236005504 00000100:00100000:1.0:1789065919.887928:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236005504 00010000:00010000:1.0:1789065919.887969:0:5823:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 28 pid: 8255 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065919.888621:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:1.0:1789065919.888634:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+28:2347:x1875971236005504:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789065919.888670:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065919.888677:0:5823:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 28 pid: 8255 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.888691:0:5823:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 28 pid: 8255 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.888714:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83482 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfad expref: 28 pid: 8255 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.888732:0:5823:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065919.888736:0:5823:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.888746:0:5823:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.888753:0:5823:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065919.888798:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065919.888879:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+27:2347:x1875971236005504:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 246us (1383us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065919.888885:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00010000:00010000:2.0:1789065919.888949:0:5839:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.888957:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065919.888999:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1789065919.889004:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789065919.889022:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889045:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889054:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889062:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889068:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889073:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.889089:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889097:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889114:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:2.0:1789065919.889116:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065919.889121:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889126:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889137:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889143:0:5839:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889148:0:5839:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889154:0:5839:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789065919.889157:0:5839:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889163:0:5839:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889170:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9cf042e0fb00) 00010000:00010000:2.0:1789065919.889172:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789065919.889174:0:5839:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889179:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83570 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889228:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1da00/0x7555615576c83562 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfec expref: 27 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889241:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfec expref: 26 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065919.889247:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065919.889249:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065919.889252:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789065919.889280:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11619:x1875971236005120:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 13701us (13939us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065919.889287:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 231 00010000:00010000:3.0:1789065920.487160:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065920.683584:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065920.683607:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258010240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065920.683684:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065920.683745:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258010240 00000100:00100000:3.0:1789065920.683753:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258010240 00000100:00100000:3.0:1789065920.683801:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789065920.683810:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971258010240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789065920.683832:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3856662528 00000100:00100000:3.0:1789065920.683877:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3297:x1875971258010240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 67us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065920.683883:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789065920.683929:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f55ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258010240:0@lo:13:osp-pre-0-0.0 00000040:00080000:2.0:1789065920.753936:0:12561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065920.753948:0:12561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065920.754822:0:12561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789065920.754830:0:12561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789065920.869835:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065920.869844:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065920.869880:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789065920.869886:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065920.870022:0:11680:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc71880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258010368:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789065920.870127:0:11680:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77540 going to sleep for 11 seconds 00000100:00100000:0.0:1789065920.884313:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065920.884402:0:11680:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc71880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11680:1875971258010368:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789065920.884633:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236005632 00000100:00100000:1.0:1789065920.884642:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236005632 00000100:00100000:1.0:1789065920.884697:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 232 00000100:00100000:1.0:1789065920.884707:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11631:x1875971236005632:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789065920.884843:0:5840:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789065920.884950:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11631:x1875971236005632:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 243us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065920.884957:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 232 00000100:00100000:0.0:1789065920.904835:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065920.905571:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236005888 00000100:00100000:2.0:1789065920.905583:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236005888 00000100:00100000:2.0:1789065920.905638:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:2.0:1789065920.905648:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+26:11631:x1875971236005888:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789065920.905679:0:8255:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065920.905701:0:8255:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8357e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdff3 expref: -99 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065920.905815:0:8255:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065920.905831:0:8255:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065920.905844:0:8255:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 8255 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789065920.905856:0:8255:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789065920.905988:0:8255:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1ce00/0x7555615576c8357e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdff3 expref: 29 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065920.906007:0:8255:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdff3 expref: 28 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065920.906015:0:8255:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065920.906018:0:8255:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789065920.906022:0:8255:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789065920.906249:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f6bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+28:11631:x1875971236005888:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 601us (1421us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789065920.906256:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 233 00000100:00100000:3.0:1789065920.915206:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065920.915246:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065920.915365:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236006144 00000100:00100000:0.0:1789065920.915374:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236006144 00000100:00100000:0.0:1789065920.915437:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 234 00000100:00100000:0.0:1789065920.915447:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+28:11631:x1875971236006144:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789065920.915533:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915574:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915587:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915794:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915803:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915809:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915815:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065920.915832:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915839:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915852:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065920.915855:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789065920.915859:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065920.915866:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049a00/0x7555615576c83593 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065920.916009:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11631:x1875971236006144:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 562us (810us total) trans 4294967518 rc 0/0 00000100:00100000:0.0:1789065920.916018:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 234 00000040:00080000:0.0:1789065920.916324:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789065920.916329:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:2.0:1789065920.917216:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236006272 00000100:00100000:2.0:1789065920.917226:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236006272 00000100:00100000:2.0:1789065920.917289:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:2.0:1789065920.917312:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2347:x1875971236006272:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065920.917326:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065920.917347:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdff3 expref: 29 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065920.917365:0:5824:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:2.0:1789065920.917369:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065920.917408:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+28:2347:x1875971236006272:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 98us (2161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065920.917416:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000040:00080000:0.0:1789065920.918322:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789065920.918336:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789065920.922999:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065920.923098:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236006528 00000100:00100000:3.0:1789065920.923108:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236006528 00000100:00100000:3.0:1789065920.923167:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 64 00000100:00100000:3.0:1789065920.923178:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+28:11631:x1875971236006528:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789065920.923415:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11631:x1875971236006528:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 238us (878us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1789065920.923422:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 64 00010000:00010000:2.0:1789065921.509797:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065921.701696:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0817bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258010496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065921.701768:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065921.701904:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258010496 00000100:00100000:0.0:1789065921.701913:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258010496 00000100:00100000:0.0:1789065921.701991:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789065921.702002:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258010496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789065921.702059:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065921.702110:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3295:x1875971258010496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065921.702117:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789065921.702185:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065921.702189:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0817bf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258010496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065921.702477:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258010880:0@lo:400:kworker.0 00000100:00100000:2.0:1789065921.702511:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065921.702534:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065921.702540:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258010752:0@lo:400:kworker.0 00000100:00100000:2.0:1789065921.702586:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065921.702614:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258010880 00000100:00100000:2.0:1789065921.702618:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258010880 00000100:00100000:2.0:1789065921.702651:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258010752 00000100:00100000:2.0:1789065921.702654:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258010752 00000100:00100000:2.0:1789065921.702670:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789065921.702676:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258010880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065921.702710:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258010880:12345-0@lo:400:kworker.0 Request processed in 35us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065921.702727:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1789065921.702741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789065921.702747:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258010752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065921.702777:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258010752:12345-0@lo:400:kworker.0 Request processed in 30us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065921.702782:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1789065921.702808:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258010752:0@lo:400:kworker.0 00000100:00100000:2.0:1789065921.702817:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc72680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258010880:0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.702929:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258010624:0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.702962:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065921.703001:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258011136:0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.703143:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065921.703240:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789065921.703247:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258011008:0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.703273:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065921.703301:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011136 00000100:00100000:3.0:1789065921.703306:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011136 00000100:00100000:3.0:1789065921.703338:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789065921.703345:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971258011136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.703382:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971258011136:12345-0@lo:400:kworker.0 Request processed in 36us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065921.703388:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1789065921.703407:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011008 00000100:00100000:3.0:1789065921.703411:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011008 00000100:00100000:3.0:1789065921.703436:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789065921.703443:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1875971258011008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.703474:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3296:x1875971258011008:12345-0@lo:400:kworker.0 Request processed in 31us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065921.703480:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789065921.703581:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258011008:0@lo:400:kworker.0 00000100:00100000:3.0:1789065921.703590:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258011136:0@lo:400:kworker.0 00000100:00080000:1.0:1789065921.703685:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789065921.703689:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789065921.703813:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258010624 00000100:00100000:0.0:1789065921.703818:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258010624 00000100:00100000:0.0:1789065921.703855:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:0.0:1789065921.703862:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971258010624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065921.703908:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971258010624:12345-0@lo:400:kworker.0 Request processed in 46us (945us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065921.703913:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:2.0:1789065921.704006:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258010624:0@lo:400:kworker.0 00000001:00080000:2.0:1789065921.846925:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1789065921.846944:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1789065921.846950:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789065921.954514:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065921.954587:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065921.954634:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065921.954653:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065921.954689:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065921.954813:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007040 00000100:00100000:1.0:1789065921.954823:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007040 00000100:00100000:1.0:1789065921.954899:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236006912 00000100:00100000:1.0:1789065921.954903:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236006912 00000100:00100000:1.0:1789065921.954928:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:1.0:1789065921.954938:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971236007040:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065921.955029:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971236007040:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 92us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065921.955048:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:1.0:1789065921.955066:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:1.0:1789065921.955073:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971236006912:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065921.955098:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc70000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971236006912:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 26us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065921.955104:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00080000:2.0:1789065921.955450:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789065921.955455:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065921.955595:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236006784 00000100:00100000:3.0:1789065921.955603:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236006784 00000100:00100000:3.0:1789065921.955663:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007168 00000100:00100000:3.0:1789065921.955666:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007168 00000100:00100000:3.0:1789065921.955691:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 185 00000100:00100000:3.0:1789065921.955697:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2349:x1875971236006784:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065921.955745:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+29:2349:x1875971236006784:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 47us (1240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065921.955765:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 185 00000100:00100000:3.0:1789065921.955782:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 186 00000100:00100000:3.0:1789065921.955788:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971236007168:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065921.955814:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971236007168:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 27us (1125us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065921.955820:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 186 00000100:00100000:3.0:1789065921.955851:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236006656 00000100:00100000:3.0:1789065921.955855:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236006656 00000100:00100000:3.0:1789065921.955881:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 309 00000100:00100000:3.0:1789065921.955888:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971236006656:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065921.955912:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971236006656:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 25us (1278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065921.955919:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 309 00000100:00080000:2.0:1789065921.956239:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789065922.534795:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789065922.857424:0:12614:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789065922.857432:0:12614:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789065922.857476:0:12614:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789065922.857482:0:12614:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789065922.983479:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065922.983488:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065922.983522:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789065922.983528:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789065923.073127:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065923.073795:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007424 00000100:00100000:0.0:1789065923.073806:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007424 00000100:00100000:0.0:1789065923.073879:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 235 00000100:00100000:0.0:1789065923.073891:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+29:11651:x1875971236007424:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789065923.073913:0:5840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065923.073935:0:5840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8359a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebcdffa expref: -99 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.074054:0:5840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c835a1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.074069:0:5840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c835a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.074094:0:5840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c835a1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789065923.074118:0:5840:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1789065923.074251:0:5840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049e00/0x7555615576c8359a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdffa expref: 32 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.074270:0:5840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c835a1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdffa expref: 31 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.074279:0:5840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065923.074282:0:5840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1789065923.074286:0:5840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b048200, rc 0) 00000100:00100000:0.0:1789065923.074348:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11651:x1875971236007424:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 459us (1229us total) trans 4294967520 rc 0/0 00000100:00100000:0.0:1789065923.074355:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 235 00000100:00080000:1.0:1789065923.074599:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065923.077606:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065923.077749:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007552 00000100:00100000:0.0:1789065923.077760:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007552 00000100:00100000:0.0:1789065923.077820:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 236 00000100:00100000:0.0:1789065923.077831:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11651:x1875971236007552:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:0.0:1789065923.077898:0:5838:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.077916:0:5838:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.077928:0:5838:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.077954:0:5838:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.077973:0:5838:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.077980:0:5838:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.077986:0:5838:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789065923.077991:0:5838:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.078000:0:5838:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.078012:0:5838:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:0.0:1789065923.078029:0:5838:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789065923.078034:0:5838:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065923.078041:0:5838:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049800/0x7555615576c835af lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5838 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065923.078134:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+31:11651:x1875971236007552:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 304us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065923.078142:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 236 00000100:00100000:0.0:1789065923.166672:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065923.166738:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007680 00000100:00100000:1.0:1789065923.166748:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007680 00000100:00100000:0.0:1789065923.166840:0:6685:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:0.0:1789065923.166853:0:6685:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0817bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971236007680:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:0.0:1789065923.166873:0:6685:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065923.166895:0:6685:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c488b74/0x7555615576c835b6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce001 expref: -99 pid: 6685 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789065923.167286:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1789065923.167471:0:6685:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa2fabd, atime: 0x6aa2fabd, ctime: 0x6aa2fabd, blocks: 0xb 00010000:00010000:3.0:1789065923.167498:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=382s v=(0 0) 00010000:00010000:3.0:1789065923.167502:0:6685:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789065923.167513:0:6685:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c488b74/0x7555615576c835b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce001 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065923.167533:0:6685:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001c488b74/0x7555615576c835b6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce001 expref: 8 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065923.167577:0:6685:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049800, rc 0) 00000100:00100000:2.0:1789065923.167752:0:6685:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0817bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2349:x1875971236007680:12345-192.168.204.23@tcp:101:cat.0 Request processed in 901us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065923.167761:0:6685:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 72 00000100:00100000:2.0:1789065923.172166:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065923.172761:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007808 00000100:00100000:0.0:1789065923.172772:0:6693:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007808 00002000:00100000:0.0:1789065923.172833:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9cf07fc71500 x1875971236007808/t0(0) o3->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:569/0 lens 488/0 e 0 to 0 dl 1789065934 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065923.172846:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07fc71500 with x1875971236007808 ext(0->4095) 00002000:00010000:0.0:1789065923.173142:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07fc71500 00000100:00100000:0.0:1789065923.173179:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1789065923.173191:0:6693:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971236007808:12345-192.168.204.23@tcp:3:cat.0 00000100:00100000:0.0:1789065923.173411:0:6693:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+8:2347:x1875971236007808:12345-192.168.204.23@tcp:3:cat.0 Request processed in 222us (1253us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789065923.173418:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00002000:00100000:0.0:1789065923.173425:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff9cf07fc71500 x1875971236007808/t0(0) o3->241917dc-ba0e-425a-830a-a04cd9f8b120@192.168.204.23@tcp:569/0 lens 488/4536 e 0 to 0 dl 1789065934 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789065923.173433:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9cf07fc71500 with x1875971236007808 ext(0->4095) 00002000:00010000:0.0:1789065923.173437:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9cf07fc71500 00010000:00010000:3.0:1789065923.558638:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065924.584789:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789065924.827898:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967325 is committed 00000001:00080000:0.0:1789065924.827912:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00000001:00080000:1.0:1789065924.843327:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:1.0:1789065924.843351:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1789065924.843377:0:5860:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9cf05093d6c0 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1789065924.843396:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf05f166c00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9cf05093d600 00000020:00080000:1.0:1789065924.843399:0:5860:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9cf05f166000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9cf07ed4c000 00000020:00080000:0.0:1789065924.843653:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1789065924.844183:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1789065925.605735:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065925.798217:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065925.798242:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258011264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789065925.798342:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065925.798504:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011264 00000100:00100000:0.0:1789065925.798511:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011264 00000100:00100000:0.0:1789065925.798605:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789065925.798615:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258011264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789065925.798658:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065925.798725:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058046680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258011264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065925.798732:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:2.0:1789065925.799101:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065925.799130:0:3298:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 2 00000004:00080000:2.0:1789065925.799137:0:3298:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07f50dc00, transno 4294967323 00000004:00080000:2.0:1789065925.799155:0:3298:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967325 committed transno 4294967325 00000100:00100000:2.0:1789065925.799184:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b275180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258011264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789065926.634252:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065926.821758:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258011776:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.821831:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.821889:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789065926.821895:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258011392:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.821928:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.821962:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258011904:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.821988:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.822024:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258011520:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822047:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.822066:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258012032:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822085:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.822104:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065926.822109:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258011648:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822141:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.822173:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011776 00000100:00100000:2.0:1789065926.822180:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011776 00000100:00100000:2.0:1789065926.822217:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012032 00000100:00100000:2.0:1789065926.822220:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012032 00000100:00100000:2.0:1789065926.822242:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789065926.822250:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258011776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822294:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258011776:12345-0@lo:400:kworker.0 Request processed in 44us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.822301:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789065926.822315:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789065926.822320:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258012032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822345:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258012032:12345-0@lo:400:kworker.0 Request processed in 25us (259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.822350:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789065926.822364:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011392 00000100:00100000:2.0:1789065926.822367:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011392 00000100:00100000:2.0:1789065926.822386:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789065926.822391:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971258011392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822414:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3297:x1875971258011392:12345-0@lo:400:kworker.0 Request processed in 23us (486us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.822420:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:2.0:1789065926.822441:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011904 00000100:00100000:2.0:1789065926.822444:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011904 00000100:00100000:2.0:1789065926.822464:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011520 00000100:00100000:2.0:1789065926.822467:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011520 00000100:00100000:2.0:1789065926.822474:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258011648 00000100:00100000:2.0:1789065926.822476:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258011648 00000100:00100000:2.0:1789065926.822495:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789065926.822500:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258011904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822525:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258011904:12345-0@lo:400:kworker.0 Request processed in 25us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.822530:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1789065926.822540:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789065926.822544:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258011520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822591:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258011520:12345-0@lo:400:kworker.0 Request processed in 46us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.822596:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1789065926.822605:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1789065926.822610:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258011648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822628:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258011648:12345-0@lo:400:kworker.0 Request processed in 19us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.822633:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:2.0:1789065926.822657:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789065926.822662:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789065926.822693:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258011648:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822702:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0508fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258011520:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.822709:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:2.0:1789065926.822713:0:3295:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:2.0:1789065926.822730:0:3295:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07f50f480, transno 4294967310 00000100:00100000:2.0:1789065926.822739:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258012032:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.823092:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258011392:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.823103:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258011904:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.823123:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf0818d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258011776:0@lo:400:kworker.0 00000100:00100000:2.0:1789065926.825308:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789065926.825329:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258012160:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065926.825395:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065926.825446:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012160 00000100:00100000:2.0:1789065926.825455:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012160 00000100:00100000:2.0:1789065926.825503:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789065926.825511:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258012160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789065926.825573:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065926.825618:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258012160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065926.825625:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1789065926.825673:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258012160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065927.088900:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065927.088950:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065927.088981:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065927.089004:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065927.089034:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065927.089077:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236007936 00000100:00100000:1.0:1789065927.089086:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236007936 00000100:00100000:1.0:1789065927.089135:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 311 00000100:00100000:1.0:1789065927.089146:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971236007936:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065927.089228:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971236007936:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 84us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065927.089236:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 311 00000100:00100000:1.0:1789065927.089270:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008192 00000100:00100000:1.0:1789065927.089274:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008192 00000100:00100000:1.0:1789065927.089310:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008320 00000100:00100000:1.0:1789065927.089313:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008320 00000100:00100000:1.0:1789065927.089337:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:1.0:1789065927.089347:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971236008192:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065927.089379:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2350:x1875971236008192:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 34us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065927.089385:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:1.0:1789065927.089398:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:1.0:1789065927.089405:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971236008320:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065927.089443:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2350:x1875971236008320:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 38us (407us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065927.089450:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:1.0:1789065927.089471:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008448 00000100:00100000:1.0:1789065927.089475:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008448 00000100:00100000:1.0:1789065927.089502:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008064 00000100:00100000:1.0:1789065927.089505:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008064 00000100:00100000:1.0:1789065927.089544:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:1.0:1789065927.089576:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971236008448:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065927.089608:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2350:x1875971236008448:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 34us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065927.089614:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 190 00000100:00100000:1.0:1789065927.089629:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00100000:1.0:1789065927.089636:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2350:x1875971236008064:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065927.089663:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2350:x1875971236008064:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065927.089669:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 191 00000100:00080000:1.0:1789065927.089691:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789065927.089696:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789065927.089699:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789065927.658170:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065928.683576:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065928.829506:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065928.829606:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008576 00000100:00100000:2.0:1789065928.829616:0:5840:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008576 00000100:00100000:2.0:1789065928.829669:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:2.0:1789065928.829679:0:5840:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11296:x1875971236008576:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1789065928.829782:0:5840:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11296:x1875971236008576:12345-192.168.204.23@tcp:60:lhsmtool_posix.0 Request processed in 104us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065928.829789:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 237 00000100:00100000:2.0:1789065928.844876:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065928.844945:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008832 00000100:00100000:2.0:1789065928.844955:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008832 00000100:00100000:2.0:1789065928.845009:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 65 00000100:00100000:2.0:1789065928.845020:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+18:11296:x1875971236008832:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789065928.845353:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+19:11296:x1875971236008832:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 333us (485us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1789065928.845360:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 65 00010000:00010000:0.0:1789065929.701828:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789065929.937949:0:5860:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1789065929.937982:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:0.0:1789065929.938032:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789065929.938042:0:5871:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1789065930.726473:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065930.918423:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065930.918445:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258012288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789065930.918510:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065930.918849:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012288 00000100:00100000:2.0:1789065930.918858:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012288 00000100:00100000:2.0:1789065930.918944:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789065930.918954:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258012288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065930.918991:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065930.919039:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258012288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065930.919046:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1789065930.919099:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b276a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258012288:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789065930.919366:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1789065930.969828:0:12815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 14:45:28 (1789065928) 00010000:00010000:2.0:1789065931.750799:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065931.942685:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789065931.942708:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258012416:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065931.942794:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065931.942880:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012416 00000100:00100000:2.0:1789065931.942889:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012416 00000100:00100000:2.0:1789065931.942956:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1789065931.942967:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258012416:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065931.942998:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258012544:0@lo:400:kworker.0 00002000:00000024:2.0:1789065931.943013:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789065931.943041:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065931.943069:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258012416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065931.943076:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ec8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258013056:0@lo:400:kworker.0 00000100:00100000:2.0:1789065931.943080:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789065931.943111:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065931.943134:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065931.943140:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258012672:0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.943161:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065931.943202:0:5832:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012544 00000100:00100000:0.0:1789065931.943206:0:5832:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012544 00000100:00100000:0.0:1789065931.943235:0:5832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789065931.943242:0:5832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971258012544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.943276:0:5832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a58850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3295:x1875971258012544:12345-0@lo:400:kworker.0 Request processed in 34us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065931.943283:0:5832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1789065931.943314:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013056 00000100:00100000:3.0:1789065931.943315:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258012928:0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.943318:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013056 00000100:00100000:0.0:1789065931.943350:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012672 00000100:00100000:0.0:1789065931.943353:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012672 00000100:00100000:3.0:1789065931.943369:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065931.943375:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789065931.943381:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971258013056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065931.943398:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789065931.943406:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258012800:0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.943431:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07edd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971258013056:12345-0@lo:400:kworker.0 Request processed in 49us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065931.943440:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065931.943444:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789065931.943461:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012800 00000100:00100000:0.0:1789065931.943464:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012800 00000100:00080000:3.0:1789065931.943466:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789065931.943473:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789065931.943501:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258012928 00000100:00100000:3.0:1789065931.943505:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258012928 00000100:00100000:3.0:1789065931.943536:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1789065931.943542:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258012928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065931.943599:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258012928:12345-0@lo:400:kworker.0 Request processed in 57us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065931.943606:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789065931.943838:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789065931.943858:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258012672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.943891:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258012672:12345-0@lo:400:kworker.0 Request processed in 46us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065931.943898:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1789065931.943910:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789065931.943916:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258012800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.943943:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258012800:12345-0@lo:400:kworker.0 Request processed in 27us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065931.943949:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1789065931.944011:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258012416:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789065931.944052:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258012672:0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.944060:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258012544:0@lo:400:kworker.0 00000100:00100000:0.0:1789065931.944069:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ec8b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258013056:0@lo:400:kworker.0 00000100:00100000:2.0:1789065931.944765:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258012800:0@lo:400:kworker.0 00000100:00100000:2.0:1789065931.944778:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07ae65180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258012928:0@lo:400:kworker.0 00000100:00100000:3.0:1789065932.194323:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065932.194696:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065932.194726:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065932.194750:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065932.194777:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065932.194815:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236009216 00000100:00100000:3.0:1789065932.194824:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236009216 00000100:00100000:3.0:1789065932.194885:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236009344 00000100:00100000:3.0:1789065932.194888:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236009344 00000100:00100000:3.0:1789065932.194909:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:3.0:1789065932.194920:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971236009216:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065932.194993:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b274a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2349:x1875971236009216:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 74us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065932.195001:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:3.0:1789065932.195019:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1789065932.195026:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971236009344:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065932.195050:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2349:x1875971236009344:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 24us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065932.195056:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1789065932.195074:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236009472 00000100:00100000:3.0:1789065932.195079:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236009472 00000100:00100000:3.0:1789065932.195180:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236009088 00000100:00100000:3.0:1789065932.195185:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236009088 00000100:00100000:3.0:1789065932.195208:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:3.0:1789065932.195216:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971236009472:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065932.195405:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b276680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2349:x1875971236009472:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 188us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065932.195412:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 195 00000100:00100000:3.0:1789065932.195427:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00100000:3.0:1789065932.195434:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2349:x1875971236009088:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789065932.195466:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b277800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+18:2349:x1875971236009088:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 32us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065932.195482:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 196 00000100:00080000:3.0:1789065932.195508:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789065932.195513:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789065932.195515:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789065932.196568:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236008960 00000100:00100000:2.0:1789065932.196578:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236008960 00000100:00100000:2.0:1789065932.196677:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 313 00000100:00100000:2.0:1789065932.196688:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971236008960:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065932.196734:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2349:x1875971236008960:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (2423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065932.197730:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 313 00000040:00080000:2.0:1789065932.199241:0:11680:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789065932.199251:0:11680:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789065932.200281:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1789065932.200291:0:11680:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789065932.782494:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065933.645275:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065933.649311:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236009600 00000100:00100000:3.0:1789065933.649401:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236009600 00000100:00100000:3.0:1789065933.649625:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 238 00000100:00100000:3.0:1789065933.649648:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+5:12317:x1875971236009600:12345-192.168.204.23@tcp:101:lsof.0 00010000:00010000:3.0:1789065933.649670:0:5839:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789065933.649702:0:5839:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c835bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce008 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065933.650836:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c835c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065933.650860:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c835c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065933.650876:0:5839:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c835c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789065933.650922:0:5839:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789065933.650928:0:5839:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789065933.650971:0:5839:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c835c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5839 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065933.651003:0:5839:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c835bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce008 expref: 7 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065933.651024:0:5839:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c835c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce008 expref: 6 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065933.651051:0:5839:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:3.0:1789065933.651055:0:5839:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789065933.651059:0:5839:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655000, rc 0) 00000100:00100000:3.0:1789065933.651132:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:59a5cafc-7436-4bd4-96e7-6564036805b9+6:12317:x1875971236009600:12345-192.168.204.23@tcp:101:lsof.0 Request processed in 1496us (5939us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065933.651141:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 238 00010000:00010000:1.0:1789065933.801771:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065934.826210:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065935.430265:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065935.430346:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236009856 00000100:00100000:1.0:1789065935.430356:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236009856 00000100:00100000:1.0:1789065935.430439:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00100000:1.0:1789065935.430454:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+18:12319:x1875971236009856:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:1.0:1789065935.430923:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:12319:x1875971236009856:12345-192.168.204.23@tcp:35:umount.0 Request processed in 472us (667us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789065935.430932:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 66 00000100:00080000:3.0:1789065935.431006:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789065935.435830:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065935.435932:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236010112 00000100:00100000:2.0:1789065935.435942:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236010112 00000100:00100000:2.0:1789065935.436016:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:2.0:1789065935.436027:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+19:12319:x1875971236010112:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:2.0:1789065935.436413:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:12319:x1875971236010112:12345-192.168.204.23@tcp:35:umount.0 Request processed in 386us (636us total) trans 4294967523 rc 0/0 00000100:00100000:2.0:1789065935.436420:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 67 00000100:00100000:0.0:1789065935.441530:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065935.442892:0:5841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236010368 00000100:00100000:2.0:1789065935.442908:0:5841:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236010368 00000100:00100000:2.0:1789065935.443029:0:5841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:2.0:1789065935.443055:0:5841:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf046ba6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+20:12319:x1875971236010368:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:2.0:1789065935.443299:0:5841:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf046ba6050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:241917dc-ba0e-425a-830a-a04cd9f8b120+21:12319:x1875971236010368:12345-192.168.204.23@tcp:35:umount.0 Request processed in 246us (1779us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1789065935.443307:0:5841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 68 00000100:00100000:0.0:1789065935.446249:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065935.446331:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236010624 00000100:00100000:3.0:1789065935.446340:0:5842:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236010624 00000100:00100000:3.0:1789065935.446399:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:3.0:1789065935.446410:0:5842:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+21:12319:x1875971236010624:12345-192.168.204.23@tcp:35:umount.0 00000100:00100000:3.0:1789065935.446776:0:5842:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+22:12319:x1875971236010624:12345-192.168.204.23@tcp:35:umount.0 Request processed in 368us (536us total) trans 4294967525 rc 0/0 00000100:00100000:3.0:1789065935.446793:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 69 00000100:00100000:1.0:1789065935.453001:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065935.453079:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236011136 00000100:00100000:3.0:1789065935.453089:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236011136 00000100:00100000:3.0:1789065935.453166:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 73 00000100:00100000:3.0:1789065935.453177:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2346:x1875971236011136:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:3.0:1789065935.453210:0:6688:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82922 00000100:00080000:3.0:1789065935.453220:0:6688:0:(import.c:65:import_set_state_nolock()) ffff9cf050a12800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789065935.453270:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1789065935.453536:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:241917dc-ba0e-425a-830a-a04cd9f8b120+2:2346:x1875971236011136:12345-192.168.204.23@tcp:9:umount.0 Request processed in 360us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065935.453545:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 73 00010000:00010000:2.0:1789065935.453890:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789065935.454514:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789065935.454981:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065935.455030:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065935.455101:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065935.455251:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236010752 00000100:00100000:2.0:1789065935.455260:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236010752 00000100:00100000:2.0:1789065935.455342:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236011008 00000100:00100000:2.0:1789065935.455345:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236011008 00000100:00100000:2.0:1789065935.455360:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236010880 00000100:00100000:2.0:1789065935.455362:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236010880 00000100:00100000:2.0:1789065935.455377:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1789065935.455385:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf05f3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+15:2350:x1875971236010752:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065935.455400:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065935.455419:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041682000/0x7555615576c8264a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb9a expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065935.455436:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065935.455481:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf05f3bd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+14:2350:x1875971236010752:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 96us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065935.455489:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1789065935.455505:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:2.0:1789065935.455511:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+13:2350:x1875971236011008:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065935.455517:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065935.455526:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072600/0x7555615576c8285e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc65 expref: 13 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065935.455573:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065935.455602:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+12:2350:x1875971236011008:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 91us (572us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065935.455608:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:2.0:1789065935.455620:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:2.0:1789065935.455625:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c199050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:2350:x1875971236010880:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065935.455631:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065935.455639:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fc200/0x7555615576c825b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdb62 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065935.455647:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065935.455660:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c199050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2350:x1875971236010880:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 35us (560us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065935.455665:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1789065935.460796:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065935.460966:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236011520 00000100:00100000:0.0:1789065935.460977:0:6687:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236011520 00000100:00100000:0.0:1789065935.461059:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00100000:0.0:1789065935.461070:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+7:2346:x1875971236011520:12345-192.168.204.23@tcp:9:umount.0 00000020:00000080:0.0:1789065935.461103:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82b8a 00000020:00010000:0.0:1789065935.461111:0:6687:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cf050a11800: total 0 00000100:00080000:0.0:1789065935.461116:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf050a14000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789065935.461157:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:0.0:1789065935.461435:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b275180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:241917dc-ba0e-425a-830a-a04cd9f8b120+5:2346:x1875971236011520:12345-192.168.204.23@tcp:9:umount.0 Request processed in 366us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065935.461444:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 74 00000100:00080000:3.0:1789065935.461773:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00010000:2.0:1789065935.461905:0:5826:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cf050a11800: total 0 00010000:00010000:2.0:1789065935.461943:0:5826:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf050a11800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789065935.462000:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c82f26 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde3a expref: 4 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065935.462035:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c488b74/0x7555615576c835b6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce001 expref: 3 pid: 6685 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065935.462049:0:5826:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf050a11800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789065935.462060:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065935.462062:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065935.462073:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065935.473318:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789065935.473465:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236012544 00000100:00100000:0.0:1789065935.473476:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236012544 00000100:00100000:0.0:1789065935.473871:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 239 00000100:00100000:0.0:1789065935.473883:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+22:2346:x1875971236012544:12345-192.168.204.23@tcp:39:umount.0 00000020:00000080:0.0:1789065935.473918:0:8255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c825be 00000020:00010000:0.0:1789065935.473937:0:8255:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cf07b233800: total 0 00000100:00080000:0.0:1789065935.473941:0:8255:0:(import.c:65:import_set_state_nolock()) ffff9cf07b232800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789065935.473975:0:8255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789065935.474440:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:241917dc-ba0e-425a-830a-a04cd9f8b120+21:2346:x1875971236012544:12345-192.168.204.23@tcp:39:umount.0 Request processed in 556us (1128us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1789065935.474450:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 239 00000020:00010000:1.0:1789065935.474521:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cf07b233800: total 0 00010000:00010000:1.0:1789065935.474598:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf07b233800, canceled 0 locks, left on hash table 13. 00010000:00010000:1.0:1789065935.474631:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf043eb1400) 00010000:00010000:1.0:1789065935.474635:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789065935.474644:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fee00/0x7555615576c828a4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc7a expref: 20 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474675:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:1.0:1789065935.474678:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789065935.474682:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654800/0x7555615576c83275 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdf28 expref: 19 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474697:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065935.474700:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065935.474704:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7800/0x7555615576c82ee7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde25 expref: 18 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474716:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065935.474718:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789065935.474736:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c82f11 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde33 expref: 17 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474752:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065935.474755:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065935.474759:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654400/0x7555615576c83497 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfb4 expref: 16 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474771:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9cf043eb1000) 00010000:00010000:1.0:1789065935.474774:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789065935.474777:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b049200/0x7555615576c82f96 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde56 expref: 15 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474807:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:1.0:1789065935.474809:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789065935.474812:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c400/0x7555615576c82f7a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcde4f expref: 14 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474824:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065935.474827:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789065935.474830:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031600/0x7555615576c82be5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdd61 expref: 13 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474842:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf043eb1500) 00010000:00010000:1.0:1789065935.474844:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789065935.474847:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0821fea00/0x7555615576c82888 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc73 expref: 12 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474861:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065935.474869:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789065935.474874:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07b048200/0x7555615576c835a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdffa expref: 11 pid: 5840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474890:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9cf06a8c0700) 00010000:00010000:1.0:1789065935.474893:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789065935.474897:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c82e07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdded expref: 10 pid: 8255 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474911:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9cf042e0f600) 00010000:00010000:1.0:1789065935.474913:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789065935.474916:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdfec expref: 9 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474932:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9cf042e0f800) 00010000:00010000:1.0:1789065935.474934:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1789065935.474937:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d400/0x7555615576c828f8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc8f expref: 8 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065935.474949:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf07b233800, canceled 13 locks, left on hash table 0. 00010000:00010000:1.0:1789065935.474963:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065935.474965:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065935.474967:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065935.846766:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065936.039679:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258013184:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789065936.039755:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065936.041677:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013184 00000100:00100000:2.0:1789065936.041691:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013184 00000100:00100000:2.0:1789065936.041789:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1789065936.041816:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258013184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789065936.041858:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789065936.041950:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ec8b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258013184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (2196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065936.041957:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1789065936.042041:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258013184:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789065936.042190:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789065936.869897:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065937.061967:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065937.061993:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258013312:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789065937.062070:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065937.062141:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258013568:0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.062142:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971258013440:0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.062185:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065937.062194:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065937.062214:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258013952:0@lo:400:kworker.0 00000100:00100000:1.0:1789065937.062222:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789065937.062232:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258013696:0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.062244:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065937.062268:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065937.062276:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258013824:0@lo:400:kworker.0 00000100:00100000:1.0:1789065937.062284:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065937.062356:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013440 00000100:00100000:0.0:1789065937.062370:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013440 00000100:00100000:0.0:1789065937.062417:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789065937.062426:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971258013440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789065937.062572:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013568 00000100:00100000:3.0:1789065937.062576:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013568 00000100:00100000:3.0:1789065937.062603:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013952 00000100:00100000:3.0:1789065937.062606:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013952 00000100:00100000:3.0:1789065937.062626:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013696 00000100:00100000:3.0:1789065937.062629:0:5839:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013696 00000100:00100000:3.0:1789065937.062641:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789065937.062647:0:5839:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258013568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.064230:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065937.064314:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013312 00000100:00100000:1.0:1789065937.064320:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1789065937.064325:0:6690:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013312 00000100:00100000:1.0:1789065937.064339:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258013952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.064380:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789065937.064390:0:6690:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258013312:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065937.064407:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258013952:12345-0@lo:400:kworker.0 Request processed in 77us (2162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065937.064414:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00002000:00000024:2.0:1789065937.064428:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789065937.064438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:1.0:1789065937.064447:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258013696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.064472:0:6690:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258013312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (2403us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065937.064495:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258013696:12345-0@lo:400:kworker.0 Request processed in 47us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.064500:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1789065937.064508:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:2.0:1789065937.064581:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789065937.064587:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789065937.064600:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258013824 00000100:00100000:2.0:1789065937.064605:0:6688:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258013824 00000100:00100000:2.0:1789065937.064636:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789065937.064642:0:6688:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258013824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789065937.064685:0:6688:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258013824:12345-0@lo:400:kworker.0 Request processed in 42us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.064692:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789065937.064718:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258013824:0@lo:400:kworker.0 00000100:00100000:1.0:1789065937.064734:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258013952:0@lo:400:kworker.0 00000100:00100000:1.0:1789065937.064766:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258013312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789065937.064891:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258013696:0@lo:400:kworker.0 00000100:00100000:0.0:1789065937.075732:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3298:x1875971258013440:12345-0@lo:400:kworker.0 Request processed in 13295us (13535us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065937.075761:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1789065937.075848:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3298:1875971258013440:0@lo:400:kworker.0 00000100:00100000:3.0:1789065937.076775:0:5839:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258013568:12345-0@lo:400:kworker.0 Request processed in 14123us (14578us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065937.076788:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1789065937.076832:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258013568:0@lo:400:kworker.0 00000001:00100000:1.0:1789065937.105979:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:1.0:1789065937.105991:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cf050a11000/241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:0.0:1789065937.106152:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf050a11000/241917dc-ba0e-425a-830a-a04cd9f8b120 for lustre-OST0001 00000020:00000080:0.0:1789065937.106278:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf050a12800 for lustre-OST0001 00000100:00100000:0.0:1789065937.321195:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065937.321347:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236012800 00000100:00100000:1.0:1789065937.321356:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236012800 00000100:00100000:1.0:1789065937.321438:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00100000:1.0:1789065937.321450:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2350:x1875971236012800:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789065937.321540:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2350:x1875971236012800:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 91us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065937.321591:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 200 00000100:00080000:2.0:1789065937.322245:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789065937.326303:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065937.326686:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236012672 00000100:00100000:2.0:1789065937.326699:0:5833:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236012672 00000100:00100000:2.0:1789065937.326809:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 315 00000100:00100000:2.0:1789065937.326822:0:5833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2349:x1875971236012672:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789065937.327347:0:5833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a5b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2349:x1875971236012672:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 523us (1066us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.327357:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 315 00000100:00100000:3.0:1789065937.700019:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065937.700070:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065937.700228:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236013056 00000100:00100000:2.0:1789065937.700238:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236013056 00000100:00100000:2.0:1789065937.700298:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236012928 00000100:00100000:2.0:1789065937.700301:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236012928 00000100:00100000:2.0:1789065937.700333:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1789065937.700343:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+11:2348:x1875971236013056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065937.700359:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065937.700378:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1d000/0x7555615576c82857 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdc5e expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065937.700424:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065937.700472:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+10:2348:x1875971236013056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 130us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.700481:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1789065937.700498:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1789065937.700505:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+9:2349:x1875971236012928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065937.700513:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065937.700521:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073400/0x7555615576c82690 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbaf expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065937.700532:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065937.700587:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:2349:x1875971236012928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 82us (516us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.700595:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1789065937.707754:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789065937.711344:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789065937.711670:0:8255:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236013440 00000100:00100000:1.0:1789065937.711680:0:8255:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236013440 00000100:00100000:1.0:1789065937.711757:0:8255:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 240 00000100:00100000:1.0:1789065937.711767:0:8255:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+6:2346:x1875971236013440:12345-192.168.204.23@tcp:39:umount.0 00000020:00000080:1.0:1789065937.711808:0:8255:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c826a5 00000020:00010000:1.0:1789065937.711816:0:8255:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cf07f17d000: total 0 00000100:00080000:1.0:1789065937.711821:0:8255:0:(import.c:65:import_set_state_nolock()) ffff9cf07f17a800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789065937.711856:0:8255:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:2.0:1789065937.712039:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236013184 00000100:00100000:2.0:1789065937.712046:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236013184 00000100:00100000:1.0:1789065937.712074:0:8255:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:59a5cafc-7436-4bd4-96e7-6564036805b9+5:2346:x1875971236013440:12345-192.168.204.23@tcp:39:umount.0 Request processed in 307us (738us total) trans 4294967527 rc 0/0 00000100:00100000:1.0:1789065937.712083:0:8255:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 240 00000100:00100000:2.0:1789065937.712088:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:2.0:1789065937.712098:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+8:2348:x1875971236013184:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789065937.712109:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789065937.712128:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041683800/0x7555615576c82697 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdbd9 expref: 8 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065937.712143:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789065937.712165:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+7:2348:x1875971236013184:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 69us (4431us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.712189:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000020:00010000:0.0:1789065937.712492:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cf07f17d000: total 0 00010000:00010000:0.0:1789065937.712497:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065937.712540:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf07f17d000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789065937.712615:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:0.0:1789065937.712619:0:5827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789065937.712626:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c835c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce008 expref: 4 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065937.712660:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf07f17d000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1789065937.712674:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065937.712676:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065937.712678:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065937.748977:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789065937.749306:0:5831:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236013696 00000100:00100000:2.0:1789065937.749316:0:5831:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236013696 00000100:00100000:2.0:1789065937.749371:0:5831:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 316 00000100:00100000:2.0:1789065937.749381:0:5831:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+7:2346:x1875971236013696:12345-192.168.204.23@tcp:251:umount.0 00000020:00000080:2.0:1789065937.749428:0:5831:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8259b 00000020:00010000:2.0:1789065937.749437:0:5831:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cf044fdf800: total 0 00000100:00080000:2.0:1789065937.749442:0:5831:0:(import.c:65:import_set_state_nolock()) ffff9cf044fdd000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789065937.749514:0:5831:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf050a59050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:bfe1882a-aaa0-4536-9098-4c2a13a5b5ba+3:2346:x1875971236013696:12345-192.168.204.23@tcp:251:umount.0 Request processed in 134us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065937.749523:0:5831:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 316 00000020:00010000:3.0:1789065937.749649:0:6701:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cf044fdf800: total 0 00010000:00010000:3.0:1789065937.749693:0:6701:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf044fdf800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789065937.749859:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041682e00/0x7555615576c82651 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebcdba1 expref: 2 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065937.749875:0:6701:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf044fdf800, canceled 1 locks, left on hash table 0. 00000020:00000080:3.0:1789065937.749886:0:6701:0:(genops.c:885:class_export_put()) final put ffff9cf044fdf800/bfe1882a-aaa0-4536-9098-4c2a13a5b5ba 00010000:00010000:3.0:1789065937.749906:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065937.749909:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065937.749911:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789065937.750158:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf044fdf800/bfe1882a-aaa0-4536-9098-4c2a13a5b5ba for MGS 00000020:00000080:2.0:1789065937.750203:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf044fdd000 for MGS 00010000:00010000:2.0:1789065937.894167:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065938.917799:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789065939.612365:0:13012:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789065939.630154:0:13012:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:0.0:1789065939.630204:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.630232:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.630240:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.630247:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.630306:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789065939.630312:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789065939.630336:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789065939.630342:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789065939.630348:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789065939.630374:0:13012:0:(import.c:65:import_set_state_nolock()) ffff9cf07a793000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789065939.630491:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971258014080:0@lo:39:umount.0 00000100:00100000:3.0:1789065939.630607:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065939.630898:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014080 00000100:00100000:0.0:1789065939.630906:0:5838:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014080 00000100:00100000:0.0:1789065939.630957:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1789065939.630968:0:5838:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875971258014080:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789065939.630995:0:5838:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c823aa 00000100:00080000:0.0:1789065939.631004:0:5838:0:(import.c:65:import_set_state_nolock()) ffff9cf07a797000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1789065939.635832:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789065939.635847:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065939.635858:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf041682200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065939.635862:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065939.635871:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065939.635879:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065939.635907:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789065939.635910:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1789065939.635913:0:6701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1789065939.636096:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065939.636389:0:5838:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3294:x1875971258014080:12345-0@lo:39:umount.0 Request processed in 5419us (5778us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065939.636400:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000020:00000080:1.0:1789065939.636414:0:5838:0:(genops.c:885:class_export_put()) final put ffff9cf07a797800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789065939.636481:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.636489:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789065939.636518:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.636525:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf041682200/0x7555615576c82620 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82627 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.636539:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065939.636541:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065939.636582:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065939.636592:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789065939.636608:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258014208:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789065939.636637:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07a797800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00100000:1.0:1789065939.636650:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065939.636715:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014208 00000100:00100000:1.0:1789065939.636723:0:5823:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014208 00000100:00100000:1.0:1789065939.636778:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789065939.636786:0:5823:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+19:3296:x1875971258014208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789065939.636802:0:5823:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789065939.636820:0:5823:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040031800/0x7555615576c82627 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c82620 expref: 19 pid: 5831 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:0.0:1789065939.636822:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07a797000 for lustre-MDT0000 00010000:00010000:1.0:1789065939.636837:0:5823:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789065939.636875:0:5823:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3296:x1875971258014208:12345-0@lo:103:ldlm_bl.0 Request processed in 90us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065939.636884:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789065939.636906:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258014208:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1789065939.637099:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07a793000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789065939.637124:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f483480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971258014080:0@lo:39:umount.0 00000100:00080000:0.0:1789065939.637598:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789065939.637603:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789065939.637618:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789065939.638949:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.638966:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.638975:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.638983:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639011:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789065939.639029:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639038:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639045:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639052:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639225:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789065939.639234:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639242:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639248:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.639254:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640344:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789065939.640355:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640365:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf041683000 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065939.640369:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640379:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065939.640386:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065939.640392:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789065939.640395:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789065939.640432:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640439:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789065939.640502:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258014336:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065939.640586:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789065939.640670:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640678:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf041683000/0x7555615576c8262e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82635 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640722:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789065939.640726:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640732:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff400 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065939.640735:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640743:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065939.640749:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065939.640753:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789065939.640756:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789065939.640758:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789065939.640775:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640781:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065939.640796:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640808:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff400/0x7555615576c82555 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c8255c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640820:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065939.640824:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065939.640833:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014336 00010000:00010000:3.0:1789065939.640835:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031a00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065939.640838:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065939.640839:0:5824:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014336 00010000:00010000:3.0:1789065939.640844:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065939.640849:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065939.640854:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789065939.640856:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:3.0:1789065939.640867:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 3/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.640872:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065939.640878:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065939.640883:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1789065939.640885:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065939.640886:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065939.640891:0:5824:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3296:x1875971258014336:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065939.640904:0:5824:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065939.640917:0:5824:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040031c00/0x7555615576c82635 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c8262e expref: 18 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.640939:0:5824:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789065939.641010:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065939.641060:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00000100:00100000:0.0:1789065939.641093:0:5824:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f483480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3296:x1875971258014336:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (505us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065939.641100:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789065939.641124:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258014464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065939.641151:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065939.641171:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789065939.641175:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258014592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065939.641196:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065939.641225:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014464 00000100:00100000:0.0:1789065939.641229:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014464 00000100:00100000:0.0:1789065939.641252:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014592 00000100:00100000:0.0:1789065939.641255:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014592 00000100:00100000:0.0:1789065939.641268:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065939.641274:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+18:3297:x1875971258014464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065939.641282:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065939.641299:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073000/0x7555615576c8255c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c82555 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.641312:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065939.641340:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+17:3297:x1875971258014464:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065939.641346:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789065939.641359:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065939.641365:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf04c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+16:3297:x1875971258014592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065939.641372:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065939.641381:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1c000/0x7555615576c82850 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c82849 expref: 16 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.641389:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065939.641410:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf04c19a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3297:x1875971258014592:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065939.641416:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789065939.641482:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258014592:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065939.641492:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3297:1875971258014464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065939.641518:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258014336:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065939.641639:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065939.641943:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065939.643087:0:13012:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031a00/0x7555615576c82849 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82850 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789065939.643102:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789065939.643171:0:13012:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.643181:0:13012:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.643187:0:13012:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.643193:0:13012:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065939.643216:0:13012:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789065939.643220:0:13012:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789065939.643223:0:13012:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789065939.643256:0:13012:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789065939.643260:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789065939.643265:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789065939.643270:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:1.0:1789065939.643275:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf07b237800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789065939.643281:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff9cf073885800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789065939.643287:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9cf07f17d000 59a5cafc-7436-4bd4-96e7-6564036805b9 192.168.204.23@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789065939.643291:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff9cf07b233800 241917dc-ba0e-425a-830a-a04cd9f8b120 192.168.204.23@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:1.0:1789065939.643295:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff9cf0581e0000) has exports, disconnecting them 00000020:00080000:1.0:1789065939.643300:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf07b237800), last request at 1789065937 00000020:00000080:1.0:1789065939.643307:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8251d 00000100:00080000:1.0:1789065939.643324:0:13012:0:(import.c:65:import_set_state_nolock()) ffff9cf07b234000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789065939.643370:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf07b237800): rc 0 00000020:00000080:1.0:1789065939.643372:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf07b237800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789065939.643386:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9cf073885800), last request at 1789065937 00000020:00000080:1.0:1789065939.643390:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82452 00000100:00080000:1.0:1789065939.643397:0:13012:0:(import.c:65:import_set_state_nolock()) ffff9cf073886000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1789065939.643408:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf073885800): rc 0 00000020:00000080:1.0:1789065939.643410:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf073885800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1789065939.643417:0:13012:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaa04822a7ae0 00000100:00080000:1.0:1789065939.643448:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789065939.643452:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 3 00000004:00080000:1.0:1789065939.643731:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789065939.643806:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1789065939.643829:0:13012:0:(import.c:65:import_set_state_nolock()) ffff9cf074ee1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1789065939.643843:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789065939.643846:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1789065939.643854:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1789065939.643908:0:13012:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1789065939.643916:0:13012:0:(import.c:65:import_set_state_nolock()) ffff9cf08164f800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:1.0:1789065939.643944:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9cf0581e0000) has no exports 00000100:00100000:3.0:1789065939.644442:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258014720:0@lo:9:umount.0 00000100:00100000:3.0:1789065939.644509:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065939.644565:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258014848:0@lo:9:umount.0 00000100:00100000:3.0:1789065939.644588:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065939.644634:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014720 00000100:00100000:3.0:1789065939.644642:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014720 00000100:00100000:3.0:1789065939.644712:0:6880:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014848 00000100:00100000:3.0:1789065939.644716:0:6880:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014848 00000100:00100000:3.0:1789065939.644743:0:6880:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789065939.644752:0:6880:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3294:x1875971258014720:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789065939.644777:0:6880:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8249f 00000100:00080000:3.0:1789065939.644784:0:6880:0:(import.c:65:import_set_state_nolock()) ffff9cf075f6f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789065939.644812:0:6880:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967325 00000100:00100000:1.0:1789065939.644943:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789065939.644954:0:6687:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3294:x1875971258014848:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789065939.644977:0:6687:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82586 00000100:00080000:1.0:1789065939.644984:0:6687:0:(import.c:65:import_set_state_nolock()) ffff9cf081895800 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789065939.644993:0:6880:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3294:x1875971258014720:12345-0@lo:9:umount.0 Request processed in 240us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065939.645002:0:6880:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000001:00000004:1.0:1789065939.645006:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00080000:3.0:1789065939.645022:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789065939.645027:0:5834:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789065939.645062:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf074ee1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789065939.645071:0:3294:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789065939.645073:0:3294:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789065939.645076:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258014720:0@lo:9:umount.0 00010000:00010000:3.0:1789065939.645101:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789065939.645109:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.645118:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ff600 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:3.0:1789065939.645122:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.645130:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789065939.645138:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789065939.645155:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789065939.645158:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789065939.645160:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789065939.645184:0:5826:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.645191:0:5826:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789065939.645208:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.645215:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ff600/0x7555615576c82309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c82310 expref: -99 pid: 5819 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065939.645230:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065939.645231:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065939.645233:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789065939.645243:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258014976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789065939.645273:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065939.645509:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258014976 00000100:00100000:0.0:1789065939.645514:0:5825:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258014976 00000100:00100000:0.0:1789065939.645566:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789065939.645574:0:5825:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+15:3295:x1875971258014976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065939.645584:0:5825:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065939.645605:0:5825:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0413fd800/0x7555615576c82310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c82309 expref: 15 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065939.645622:0:5825:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065939.645659:0:5825:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8c7529dd-e8b4-44e5-b83f-e77028f31a41+14:3295:x1875971258014976:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065939.645667:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789065939.645714:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258014976:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065939.645736:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789065939.645893:0:6687:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3294:x1875971258014848:12345-0@lo:9:umount.0 Request processed in 941us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065939.645902:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000020:00000080:2.0:1789065939.646024:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07b237800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1789065939.646084:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf073885800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1789065939.646109:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07b234000 for lustre-MDT0000 00000020:00000080:2.0:1789065939.646236:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf073886000 for lustre-MDT0000 00010000:00010000:2.0:1789065939.646247:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789065939.646410:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf08164f800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1789065939.646429:0:3294:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1789065939.646431:0:3294:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789065939.646435:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258014848:0@lo:9:umount.0 00000020:00080000:0.0:1789065939.657822:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff9cf0581e0000) has no exports 00000020:00000080:0.0:1789065939.711349:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82364 00000020:00000080:0.0:1789065939.711367:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf074ec4000/lustre-QMT0000_UUID 00000020:01000000:0.0:1789065939.711436:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1789065939.711509:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf074ec4000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1789065939.711537:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789065939.711713:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789065939.711734:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff9cf074eab380) has no exports 00000020:00000080:1.0:1789065939.712405:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8235d 00000020:00000080:1.0:1789065939.712413:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf074ea0000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789065939.712480:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf074ea0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789065939.712708:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789065939.712716:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:1.0:1789065939.712719:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf074ea6000/lustre-QMT0000_UUID 00000020:00000080:1.0:1789065939.712722:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf074ea6000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:1.0:1789065939.712726:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:3.0:1789065939.942498:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789065940.201524:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000001:00080000:2.0:1789065940.201543:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000001:00100000:2.0:1789065940.201580:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 59a5cafc-7436-4bd4-96e7-6564036805b9 00000001:00080000:2.0:1789065940.201585:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:2.0:1789065940.201588:0:5860:0:(genops.c:885:class_export_put()) final put ffff9cf07f17d000/59a5cafc-7436-4bd4-96e7-6564036805b9 00000020:00000080:2.0:1789065940.201616:0:5860:0:(genops.c:885:class_export_put()) final put ffff9cf07b233800/241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:2.0:1789065940.201631:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17d000/59a5cafc-7436-4bd4-96e7-6564036805b9 for lustre-MDT0000 00000020:00000080:2.0:1789065940.201706:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07b233800/241917dc-ba0e-425a-830a-a04cd9f8b120 for lustre-MDT0000 00000020:00000080:2.0:1789065940.201735:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07f17a800 for lustre-MDT0000 00000020:00000080:2.0:1789065940.201742:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07b232800 for lustre-MDT0000 00000001:00100000:2.0:1789065940.226628:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 241917dc-ba0e-425a-830a-a04cd9f8b120 00000020:00000080:2.0:1789065940.226641:0:6711:0:(genops.c:885:class_export_put()) final put ffff9cf050a11800/241917dc-ba0e-425a-830a-a04cd9f8b120 00000001:00100000:2.0:1789065940.226675:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789065940.226682:0:6711:0:(genops.c:885:class_export_put()) final put ffff9cf075f69800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789065940.226789:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf050a11800/241917dc-ba0e-425a-830a-a04cd9f8b120 for lustre-OST0000 00000020:00000080:1.0:1789065940.226843:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf075f69800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:1.0:1789065940.226862:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf050a14000 for lustre-OST0000 00000020:00000080:1.0:1789065940.226866:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf075f6f000 for lustre-OST0000 00010000:00010000:0.0:1789065940.965878:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789065941.733770:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf07a8d3cc0 - data ffff9cf066277870/ffff9cf081782000 00000020:01000000:1.0:1789065941.733902:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf051fad180 - data ffff9cf066022798/ffff9cf052fbb800 00000001:00000004:1.0:1789065941.739134:0:13012:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:3.0:1789065941.857678:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789065941.857687:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 4 00000004:00080000:3.0:1789065941.857761:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789065941.857765:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789065941.858229:0:6861:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789065941.858234:0:6861:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:0.0:1789065941.858244:0:6861:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1789065941.859223:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789065941.859229:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:3.0:1789065941.859249:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789065941.859251:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789065941.865880:0:8070:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789065941.865890:0:8070:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:0.0:1789065941.865916:0:8070:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1789065941.966442:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8232c 00000020:00000080:3.0:1789065941.966455:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04589e000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789065941.966517:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04589e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789065941.970206:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82341 00000020:00000080:3.0:1789065941.970220:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf0818e5000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789065941.970240:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1789065941.970247:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065941.970254:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789065941.970258:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff9cf0581e19c0) has no exports 00000004:01000000:3.0:1789065941.970417:0:13012:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1789065941.970425:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8257f 00000020:00000080:3.0:1789065941.970430:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf08164f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789065941.970434:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789065941.970437:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065941.970443:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789065941.970445:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff9cf074ea8000) has no exports 00000020:00000080:3.0:1789065941.970450:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82578 00000020:00000080:3.0:1789065941.970453:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf08164d800/lustre-MDT0000-osd_UUID 00010000:01000000:3.0:1789065941.971305:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789065941.971312:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789065941.971316:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1789065941.971323:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789065941.971325:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789065941.971364:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065941.971373:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065941.971380:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82498 00000020:00000080:3.0:1789065941.971386:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf07f308000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1789065941.971393:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1789065941.971397:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065941.971400:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789065941.971403:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff9cf06a514d40) has no exports 00000020:00000080:3.0:1789065941.971408:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82491 00000020:00000080:3.0:1789065941.971410:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf073883000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789065941.971526:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0818e5000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:00000080:0.0:1789065941.971539:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf08164f000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789065941.971546:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf08164d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789065941.971582:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf08164f800 for lustre-OST0001-osc-MDT0000 00000020:00000080:0.0:1789065941.971588:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf08164d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789065941.971590:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf08164d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:0.0:1789065941.971594:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789065941.971682:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f308000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1789065941.971687:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf073883000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1789065941.972386:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1789065941.972392:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789065941.972403:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967325 gen 5 00000004:00080000:3.0:1789065941.972408:0:13012:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789065941.972410:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789065941.972444:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789065941.972452:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf074ee1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789065941.972453:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789065941.972462:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf07f179800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789065941.972465:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f179800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1789065941.972470:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065941.972485:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065941.972490:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065941.972494:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04589a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789065941.972497:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04589a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1789065941.972504:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065941.974486:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82348 00000020:00000080:3.0:1789065941.974500:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf0818e0000/lustre-MDD0000_UUID 00000020:01000000:3.0:1789065941.974518:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1789065941.974526:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065941.974533:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789065941.974537:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff9cf0581e3380) has no exports 00000020:00000080:3.0:1789065941.974583:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065941.974588:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1789065941.974592:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8234f 00000020:00000080:3.0:1789065941.974596:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf0818e4800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789065941.974604:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf04c2a4800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1789065941.974607:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf04c2a4800 3 00000020:01000004:3.0:1789065941.974610:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf04c2a4800 from lustre-MDT0000 00000020:00000080:3.0:1789065941.974640:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065941.974644:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1789065941.974647:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04589b000/lustre-MDT0000_UUID 00000020:00000080:3.0:1789065941.974650:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04589b000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1789065941.974674:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1789065941.974729:0:13012:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1789065941.974733:0:13012:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1789065941.974736:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1789065941.974739:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065941.974752:0:13012:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789065941.974758:0:13012:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff9cf050849800 8c7529dd-e8b4-44e5-b83f-e77028f31a41 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789065941.974764:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff9cf050e98000) has exports, disconnecting them 00000020:00080000:3.0:1789065941.974769:0:13012:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9cf050849800), last request at 1789065681 00000020:00000080:3.0:1789065941.974783:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c822ed 00000020:00010000:3.0:1789065941.974788:0:13012:0:(genops.c:1920:obd_stale_export_put()) Put export ffff9cf050849800: total 2 00000100:00080000:3.0:1789065941.974792:0:13012:0:(import.c:65:import_set_state_nolock()) ffff9cf05084f000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789065941.974813:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf050849800): rc 0 00000020:00080000:3.0:1789065941.974818:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff9cf050e98000) has no exports 00000100:00100000:3.0:1789065941.974921:0:5832:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff9cf043c4ae00:5832] 1 exiting: rc = 0 00000020:00000080:0.0:1789065941.975357:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0818e0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1789065941.975364:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf0818e5800/lustre-MDD0000_UUID 00000020:00000080:0.0:1789065941.975366:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0818e5800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:0.0:1789065941.975371:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00010000:1.0:1789065941.975630:0:5827:0:(genops.c:1906:obd_stale_export_get()) Get export ffff9cf050849800: total 2 00010000:00010000:1.0:1789065941.975680:0:5827:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9cf050849800, canceled 0 locks, left on hash table 8. 00010000:00010000:1.0:1789065941.975707:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf041683e00/0x7555615576c8260b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c82604 expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975722:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072200/0x7555615576c82619 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c82612 expref: 8 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975732:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0821ff000/0x7555615576c82834 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c8282d expref: 7 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975741:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072400/0x7555615576c82842 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c8283b expref: 6 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975754:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b072000/0x7555615576c82405 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c823fe expref: 5 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975773:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073600/0x7555615576c82643 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c8263c expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975786:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf06b073e00/0x7555615576c825fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c825f6 expref: 3 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975796:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040030400/0x7555615576c825ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x7555615576c825e8 expref: 2 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065941.975807:0:5827:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9cf050849800, canceled 8 locks, left on hash table 0. 00000020:00000080:1.0:1789065941.975819:0:5827:0:(genops.c:885:class_export_put()) final put ffff9cf050849800/8c7529dd-e8b4-44e5-b83f-e77028f31a41 00010000:00010000:1.0:1789065941.975831:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065941.975833:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065941.975835:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789065941.976672:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0818e4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789065941.977370:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf050849800/8c7529dd-e8b4-44e5-b83f-e77028f31a41 for MGS 00000020:00000080:0.0:1789065941.977409:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf05084f000 for MGS 00000100:00100000:2.0:1789065941.978337:0:5831:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff9cf04c229800:5831] 0 exiting: rc = 1 00000100:00100000:3.0:1789065941.985016:0:5833:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff9cf0508b2400:5833] 2 exiting: rc = 0 00000100:00100000:1.0:1789065941.985195:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985205:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985213:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985219:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985225:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985231:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985237:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985243:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985248:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985253:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985259:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985264:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985276:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985282:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985289:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985295:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985300:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985324:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985330:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985336:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985342:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985347:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985353:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985359:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985365:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985370:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985375:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985380:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985386:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985392:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985397:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985402:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985406:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985412:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985417:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985422:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985428:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985433:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985438:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985444:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985449:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985453:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985458:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985464:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985469:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985475:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985481:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985486:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985492:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985497:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985502:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985507:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985521:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985526:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985532:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985537:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985544:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985588:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985594:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985600:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985606:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985611:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985616:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065941.985621:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:1.0:1789065941.986958:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789065941.986966:0:13012:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:3.0:1789065941.991841:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789065942.000399:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf06a6512a0 - data ffff9cf073c5c1b0/ffff9cf07ee77400 00000020:01000000:1.0:1789065942.000743:0:13012:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf06a51b660 - data ffff9cf06bb1c288/ffff9cf05179b800 00000020:00000080:1.0:1789065942.001640:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c822d1 00000020:00000080:1.0:1789065942.001650:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04628f800/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1789065942.001726:0:13012:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf04c2a4800 from MGS, refs=2 00000020:01000004:1.0:1789065942.001730:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf04c2a4800 2 00000020:01000004:1.0:1789065942.001733:0:13012:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf04c2a4800 from MGS 00000020:00000080:1.0:1789065942.001752:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789065942.001759:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1789065942.001761:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04c2a7800/MGS 00000020:00000080:1.0:1789065942.001763:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04c2a7800/MGS for MGS 00000020:01000000:1.0:1789065942.001771:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1789065942.001915:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1789065942.001920:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789065942.001926:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789065942.001932:0:13012:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9cf07a796000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789065942.002002:0:13012:0:(genops.c:1552:class_disconnect_exports()) OBD device 8 (ffff9cf050e9cd40) has exports, disconnecting them 00000020:00080000:1.0:1789065942.002008:0:13012:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9cf07a796000), last request at 1789065682 00000020:00000080:1.0:1789065942.002013:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8239c 00000020:00080000:1.0:1789065942.002042:0:13012:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf07a796000): rc 0 00000020:00000080:1.0:1789065942.002047:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf07a796000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789065942.002407:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04628f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789065942.003368:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07a796000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789065942.005604:0:13012:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789065942.005612:0:13012:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789065942.005618:0:13012:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789065942.005625:0:13012:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789065942.005820:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789065942.005829:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789065942.005836:0:13012:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf04c2a4800 1 00000020:00000080:0.0:1789065942.005843:0:13012:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c822c3 00000020:00000080:0.0:1789065942.005865:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04c2a2000/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1789065942.005882:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789065942.005886:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789065942.005891:0:13012:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789065942.005895:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff9cf050e999c0) has no exports 00000020:00000080:3.0:1789065942.006369:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07a793000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789065942.006379:0:38:0:(genops.c:885:class_export_put()) final put ffff9cf07a795000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789065942.006383:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07a795000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789065942.006393:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1789065942.006451:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04c2a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789065942.113140:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789065942.113156:0:13012:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789065942.113162:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf04c2a5800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789065942.113167:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf04c2a5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789065942.113178:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789065942.113373:0:13012:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf04c2a1000 00000020:01000000:0.0:1789065942.113402:0:13012:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789065942.113407:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789065942.113412:0:13012:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789065942.113416:0:13012:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff9cf050e9b380) has no exports 00000100:00100000:1.0:1789065942.114015:0:8255:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff9cf07f6a6000:8255] 3 exiting: rc = 0 00000100:00100000:1.0:1789065942.114188:0:5838:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff9cf0581e9600:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1789065942.119696:0:5840:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff9cf0581e8c00:5840] 2 exiting: rc = 0 00000100:00100000:0.0:1789065942.119831:0:5839:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff9cf0581e9c00:5839] 1 exiting: rc = 0 00000100:00100000:1.0:1789065942.120609:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120619:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120625:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120631:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120637:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120643:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120649:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120665:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120672:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120678:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120684:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120689:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120695:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120701:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120707:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120711:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120731:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120738:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120743:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120749:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120755:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120761:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120766:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120772:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120778:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120783:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120789:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120796:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120802:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120808:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120813:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120833:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120839:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120845:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120850:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120855:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120861:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120867:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120873:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120879:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120885:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120891:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120897:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120902:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120910:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120916:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120922:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120928:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120934:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.120940:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121111:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121122:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121128:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121133:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121138:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121144:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121150:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121156:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121161:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121167:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121173:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121178:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121184:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.121190:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.146956:0:5841:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9cf050e43400:5841] 0 exiting: rc = 1 00000100:00100000:3.0:1789065942.148673:0:5842:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9cf050e42600:5842] 1 exiting: rc = 0 00000100:00100000:1.0:1789065942.149367:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149379:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149399:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149404:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149409:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149414:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149419:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149430:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149436:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149441:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149446:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149453:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149471:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149477:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149482:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149487:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149492:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149498:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149504:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149509:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149514:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149519:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149524:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149529:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149534:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149538:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149544:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149576:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149582:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149587:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149593:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149598:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149603:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149608:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149613:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149618:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149623:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149635:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149641:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149646:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149661:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149667:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149673:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149678:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149683:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149688:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149693:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149698:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149702:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149707:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149712:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149895:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149901:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149906:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149911:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149916:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149920:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149925:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149931:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149936:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149942:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149958:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149964:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.149968:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.155105:0:5843:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff9cf050d5c400:5843] 0 exiting: rc = 1 00000100:00100000:0.0:1789065942.157184:0:5844:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff9cf058210e00:5844] 1 exiting: rc = 0 00000100:00100000:1.0:1789065942.157414:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157423:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157429:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157435:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157441:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157447:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157491:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157499:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157524:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157530:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157536:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157577:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157584:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157590:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157597:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157603:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157608:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157613:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157638:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157645:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157662:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157669:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157676:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157683:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157689:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157695:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157701:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157707:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157965:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.157976:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158001:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158010:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158016:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158023:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158031:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158037:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158051:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158059:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158070:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158077:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158084:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158095:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158121:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158139:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158147:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158155:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158164:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158173:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158180:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158188:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158195:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158202:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158208:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158216:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158246:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158254:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158266:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158272:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158281:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158286:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158292:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158298:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158305:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.158312:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.171714:0:5845:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9cf047675600:5845] 0 exiting: rc = 1 00000100:00100000:1.0:1789065942.172178:0:5846:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9cf058218000:5846] 1 exiting: rc = 0 00000100:00100000:0.0:1789065942.173933:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173943:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173949:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173954:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173958:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173964:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173969:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173974:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173979:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173984:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173989:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.173995:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174000:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174005:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174010:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174034:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174039:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174045:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174050:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174055:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174061:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174065:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174070:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174074:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174080:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174084:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174090:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174094:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174099:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174103:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174108:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174112:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174117:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174121:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174127:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174133:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174139:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174144:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174149:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174155:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174160:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174164:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174169:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174175:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174180:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174185:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174190:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174196:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174201:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174206:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174220:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174225:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174230:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174236:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174241:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174246:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174251:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174257:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174263:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174268:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174273:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174278:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174283:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789065942.174288:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.181466:0:5847:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9cf058219a00:5847] 0 exiting: rc = 1 00000100:00100000:1.0:1789065942.186114:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258015104:0@lo:400:kworker.0 00000400:00000100:1.0:1789065942.186171:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875971258015104 offset 0 length 224: 4 00000100:00100000:1.0:1789065942.186255:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258015232:0@lo:400:kworker.0 00000400:00000100:1.0:1789065942.186279:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258015232 offset 0 length 224: 4 00000100:00100000:1.0:1789065942.186295:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789065942.186301:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258015360:0@lo:400:kworker.0 00000400:00000100:1.0:1789065942.186316:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258015360 offset 0 length 224: 4 00000100:00100000:3.0:1789065942.186462:0:5848:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9cf05820ee00:5848] 1 exiting: rc = 0 00000100:00100000:1.0:1789065942.186696:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186730:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186736:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186742:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186747:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186752:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186756:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186761:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186768:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186772:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186777:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186783:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186788:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186793:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186798:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186802:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186807:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186812:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186818:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186823:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186828:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186832:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186837:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186842:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186846:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186851:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186855:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186860:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186864:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186868:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186873:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186877:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186881:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186885:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186890:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186895:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186907:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186912:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186917:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186922:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186926:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186932:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186938:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186944:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186949:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186954:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186959:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186965:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186971:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186976:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186982:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186987:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186992:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.186997:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187002:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187007:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187013:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187017:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187024:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187029:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187034:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187040:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187045:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.187051:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.187613:0:5849:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff9cf05820f600:5849] 0 exiting: rc = 1 00000100:00100000:1.0:1789065942.192769:0:5850:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff9cf05820fc00:5850] 1 exiting: rc = 0 00000100:00100000:3.0:1789065942.192933:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192940:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192945:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192950:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192955:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192959:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192963:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192967:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192991:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.192997:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193003:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193008:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193013:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193018:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193023:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193027:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193032:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193037:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193042:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193047:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193051:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193057:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193064:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193069:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193074:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193078:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193084:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193089:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193094:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193099:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193104:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193108:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193114:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193120:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193125:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193130:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193135:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193141:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193146:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193150:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193156:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193161:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193166:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193181:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193185:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193191:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193196:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193200:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193205:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193210:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193215:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193220:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193226:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193231:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193236:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193241:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193246:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193251:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193257:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193262:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193266:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193271:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193276:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.193282:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065942.196193:0:5851:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff9cf0581fd400:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789065942.196468:0:5852:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff9cf058219400:5852] 1 exiting: rc = 0 00000100:00100000:2.0:1789065942.201746:0:5853:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff9cf058218800:5853] 2 exiting: rc = 0 00000100:00100000:3.0:1789065942.202040:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202048:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202054:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202071:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202078:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202084:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202090:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202096:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202100:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202106:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202112:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202118:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202123:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202128:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202141:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202146:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202152:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202158:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202164:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202170:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202175:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202181:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202186:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202192:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202197:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202202:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202207:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202224:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202230:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202247:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202254:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202259:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202264:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202275:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202281:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202286:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202291:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202297:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202301:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202307:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202312:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202317:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202323:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202329:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202334:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202339:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202344:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202349:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202354:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202367:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202372:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202395:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202401:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202407:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202412:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202418:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202423:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202429:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202434:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202440:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202446:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202450:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202456:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065942.202462:0:13012:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789065942.221201:0:13012:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065942.221216:0:13012:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1789065942.221222:0:13012:0:(genops.c:885:class_export_put()) final put ffff9cf051771000/MDS_uuid 00000020:00000080:3.0:1789065942.221227:0:13012:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf051771000/MDS_uuid for MDS 00000020:01000000:3.0:1789065942.221237:0:13012:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1789065942.221361:0:13012:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00000001:00100000:0.0:1789065942.292685:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789065942.292695:0:7636:0:(genops.c:885:class_export_put()) final put ffff9cf081893800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789065942.295976:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf081893800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789065942.296045:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf081895800 for lustre-OST0001 00010000:00010000:0.0:1789065943.013973:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065944.040812:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065945.062496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789065945.578186:0:13166:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789065945.595395:0:13166:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1789065945.595444:0:13166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065945.595474:0:13166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065945.595481:0:13166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065945.595488:0:13166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065945.595771:0:13166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789065945.595846:0:13166:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789065945.595871:0:13166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789065945.595883:0:13166:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07b269180 x1875971258015232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065945.595906:0:13166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789065945.595912:0:13166:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789065945.595937:0:13166:0:(import.c:65:import_set_state_nolock()) ffff9cf07f179000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789065945.596000:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3294:1875971258015488:0@lo:39:umount.0 00000400:00000100:3.0:1789065945.596050:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258015488 offset 0 length 224: 4 00000100:00100000:2.0:1789065945.596161:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258015232:0@lo:400:kworker.0 00010000:00010000:0.0:1789065945.596210:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065945.596218:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065945.596226:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1cc00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065945.596229:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065945.596238:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065945.596244:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065945.596260:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789065945.596263:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789065945.596265:0:6701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789065945.596290:0:6701:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065945.596295:0:6701:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789065945.596339:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258015616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789065945.596377:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789065945.596442:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065945.596451:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1cc00/0x7555615576c82604 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x7555615576c8260b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065945.596463:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065945.596465:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065945.596467:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789065945.597086:0:8446:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258015616 00000100:00100000:2.0:1789065945.597095:0:8446:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258015616 00000100:00100000:2.0:1789065945.597175:0:8446:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789065945.597184:0:8446:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3295:x1875971258015616:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1789065945.597192:0:8446:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789065945 with bad export cookie 8454770895150916333 00000100:00100000:2.0:1789065945.605398:0:8446:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3295:x1875971258015616:12345-0@lo:103:ldlm_bl.0 Request processed in 8205us (9012us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789065945.605412:0:8446:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789065945.605699:0:3295:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.123@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789065945.605704:0:3295:0:(import.c:65:import_set_state_nolock()) ffff9cf05084c000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789065945.605708:0:3295:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.123@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:1.0:1789065945.612184:0:3295:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.123@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789065945.612191:0:3295:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789065945.612201:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07b268e00 x1875971258015104/t0(0) o400->MGC192.168.204.123@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1789065958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065945.612334:0:3295:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07b0b3480 x1875971258015616/t0(0) o103->MGC192.168.204.123@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789065961 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789065945.612344:0:3295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789065945.612347:0:3295:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789065945.612348:0:3295:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:1.0:1789065945.612351:0:3295:0:(import.c:65:import_set_state_nolock()) ffff9cf05084c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789065945.612356:0:3295:0:(import.c:545:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 141 00000100:00080000:1.0:1789065945.612371:0:3295:0:(import.c:666:import_select_connection()) MGC192.168.204.123@tcp: import ffff9cf05084c000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:1.0:1789065945.612401:0:3295:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07b269f80 x1875971258015744/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789065945.612443:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3295:1875971258015616:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065945.612515:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3294:1875971258015744:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:0.0:1789065945.612602:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875971258015744 offset 0 length 520: 4 00000100:00100000:3.0:1789065945.613176:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3296:1875971258015104:0@lo:400:kworker.0 00010000:00010000:1.0:1789065946.086225:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065947.110309:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789065947.302887:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789065947.302899:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789065947.303021:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258015872:0@lo:400:kworker.0 00000400:00000100:2.0:1789065947.303076:0:3296:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258015872 offset 0 length 224: 4 00010000:00010000:0.0:1789065948.134276:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065949.158170:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065950.182015:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789065950.309871:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789065950.309881:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789065950.309998:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258016000:0@lo:400:kworker.0 00000400:00000100:2.0:1789065950.310055:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258016000 offset 0 length 224: 4 00010000:00010000:0.0:1789065951.210853:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065952.229860:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065953.254183:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065954.279001:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065955.301789:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789065955.494112:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789065955.494133:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789065955.494496:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789065955.494517:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258016128:0@lo:400:kworker.0 00000400:00000100:3.0:1789065955.494600:0:3297:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258016128 offset 0 length 224: 4 00000100:00100000:0.0:1789065956.005687:0:3294:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789065945/real 1789065945] req@ffff9cf07b269f80 x1875971258015744/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789065955 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065956.005725:0:3294:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf07b269f80 x1875971258015744/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789065955 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065956.005761:0:3294:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789065945/real 1789065945] req@ffff9cf07b26a680 x1875971258015488/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789065955 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065956.005776:0:3294:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf07b26a680 x1875971258015488/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789065955 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789065956.005795:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf05084c000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789065956.005824:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1789065956.005828:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3294:1875971258015744:0@lo:250:ptlrpcd_00_00.0 00000100:00080000:0.0:1789065956.005836:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07f179000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1789065956.005854:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3294:1875971258015488:0@lo:39:umount.0 00000100:00080000:3.0:1789065956.005955:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789065956.005961:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1789065956.005965:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cf05084c000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789065956.005970:0:38:0:(import.c:545:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 404 00000100:00080000:3.0:1789065956.005976:0:38:0:(import.c:630:import_select_connection()) MGC192.168.204.123@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789065956.006001:0:38:0:(import.c:666:import_select_connection()) MGC192.168.204.123@tcp: import ffff9cf05084c000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789065956.006032:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70c000 x1875971258016256/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789065956.006143:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3294:1875971258016256:0@lo:250:kworker.0 00000400:00000100:0.0:1789065956.006184:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875971258016256 offset 0 length 520: 4 00000100:00080000:1.0:1789065956.006409:0:13166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789065956.006414:0:13166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789065956.006419:0:13166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00100000:2.0:1789065956.006429:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258016384:0@lo:400:kworker.0 00000400:00000100:2.0:1789065956.006458:0:3295:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258016384 offset 0 length 224: 4 00010000:00010000:1.0:1789065956.007309:0:13166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007330:0:13166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007338:0:13166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007345:0:13166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007397:0:13166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789065956.007407:0:13166:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007415:0:13166:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007421:0:13166:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007428:0:13166:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065956.007446:0:13166:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789065956.007451:0:13166:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1789065956.007472:0:13166:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1789065956.007476:0:13166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1789065956.007481:0:13166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789065956.007487:0:13166:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789065956.007491:0:13166:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9cf07eed4d40) has no exports 00000020:00080000:1.0:1789065956.007515:0:13166:0:(genops.c:1557:class_disconnect_exports()) OBD device 11 (ffff9cf07eed4d40) has no exports 00010000:00010000:0.0:1789065956.010060:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789065956.010079:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010093:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030e00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065956.010098:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010108:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065956.010116:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065956.010147:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789065956.010150:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1789065956.010154:0:6701:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1789065956.010173:0:6701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:0.0:1789065956.010177:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010184:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040030e00/0x7555615576c82612 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82619 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010201:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065956.010205:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010211:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0821ffa00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065956.010213:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010219:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065956.010225:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065956.010230:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789065956.010232:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789065956.010234:0:6701:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789065956.010240:0:6701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:0.0:1789065956.010242:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010254:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0821ffa00/0x7555615576c8283b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82842 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065956.010263:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065956.010264:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065956.010266:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789065956.010421:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1789065956.011150:0:13166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf06a651180 - data ffff9cf073c5c798/ffff9cf07ee77000 00000020:01000000:1.0:1789065956.011346:0:13166:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf050d4ff60 - data ffff9cf06bb44e58/ffff9cf07ee80800 00100000:10000000:1.0:1789065956.021760:0:13166:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789065956.102378:0:13166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82421 00000020:00000080:0.0:1789065956.102401:0:13166:0:(genops.c:885:class_export_put()) final put ffff9cf07ec25000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1789065956.102425:0:13166:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf07a795800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1789065956.102429:0:13166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf07a795800 2 00000020:01000004:0.0:1789065956.102432:0:13166:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf07a795800 from lustre-OST0000 00000020:00000080:0.0:1789065956.102459:0:13166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789065956.102469:0:13166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1789065956.102472:0:13166:0:(genops.c:885:class_export_put()) final put ffff9cf07ec21800/lustre-OST0000_UUID 00000020:00000080:0.0:1789065956.102475:0:13166:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07ec21800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1789065956.102486:0:13166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1789065956.102538:0:13166:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1789065956.102543:0:13166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1789065956.102572:0:13166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789065956.102578:0:13166:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789065956.102585:0:13166:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9cf07f17e800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789065956.102591:0:13166:0:(genops.c:1552:class_disconnect_exports()) OBD device 12 (ffff9cf06a513380) has exports, disconnecting them 00000020:00080000:0.0:1789065956.102597:0:13166:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9cf07f17e800), last request at 1789065702 00000020:00000080:0.0:1789065956.102601:0:13166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c8244b 00000020:00080000:0.0:1789065956.102612:0:13166:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf07f17e800): rc 0 00000020:00000080:0.0:1789065956.102618:0:13166:0:(genops.c:885:class_export_put()) final put ffff9cf07f17e800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789065956.103917:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07ec25000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789065956.103931:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17e800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1789065956.106295:0:13166:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789065956.106305:0:13166:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789065956.106309:0:13166:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789065956.106317:0:13166:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789065956.106648:0:13166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789065956.106660:0:13166:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1789065956.106668:0:13166:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf07a795800 1 00000020:00000080:2.0:1789065956.106675:0:13166:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c823db 00000020:00000080:2.0:1789065956.106683:0:13166:0:(genops.c:885:class_export_put()) final put ffff9cf0818e7800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789065956.106687:0:13166:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789065956.106694:0:13166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789065956.106698:0:13166:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789065956.106702:0:13166:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff9cf06a5119c0) has no exports 00000020:00000080:3.0:1789065956.106820:0:38:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf07f179000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1789065956.106828:0:38:0:(genops.c:885:class_export_put()) final put ffff9cf07f17c000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789065956.106831:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17c000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1789065956.106839:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1789065956.106894:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0818e7800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1789065956.120030:0:13166:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065956.120047:0:13166:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1789065956.120053:0:13166:0:(genops.c:885:class_export_put()) final put ffff9cf07a796800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1789065956.120057:0:13166:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07a796800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1789065956.120065:0:13166:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1789065956.120211:0:13166:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf07a791000 00000020:02000400:3.0:1789065956.120260:0:13166:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:0.0:1789065956.329910:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065957.349698:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065958.382272:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1789065958.566307:0:3297:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789065942/real 1789065942] req@ffff9cf07b26b800 x1875971258015360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789065958 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789065958.600761:0:3297:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9cf07b26b800 x1875971258015360/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789065958 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789065958.600777:0:3297:0:(import.c:65:import_set_state_nolock()) ffff9cf08164c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789065958.600781:0:3297:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789065958.621841:0:3297:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0000_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1789065958.621966:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789065958.621973:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789065958.621977:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789065958.621980:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789065958.621984:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cf08164c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789065958.621993:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 182 00000100:00080000:0.0:1789065958.622010:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cf08164c800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1789065958.622056:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07b0b1500 x1875971258016512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789065958.622106:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3294:1875971258016512:0@lo:38:kworker.0 00000400:00000100:0.0:1789065958.622176:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875971258016512 offset 0 length 520: 4 00000100:00100000:0.0:1789065958.622266:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258015360:0@lo:400:kworker.0 00000020:01000004:0.0:1789065958.809414:0:13319:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789065958.822690:0:13319:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1789065958.822779:0:13319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065958.822798:0:13319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065958.822813:0:13319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065958.822821:0:13319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065958.822912:0:13319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789065958.822919:0:13319:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789065958.822947:0:13319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789065958.822960:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07b0b0000 x1875971258015872/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065963 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.822977:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70f800 x1875971258016000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065966 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789065958.823422:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258015872:0@lo:400:kworker.0 00000100:00100000:1.0:1789065958.823594:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70ea00 x1875971258016128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.823604:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70e680 x1875971258016384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065972 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.823617:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07b0b1500 x1875971258016512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789065968 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.823627:0:13319:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789065958.823635:0:13319:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00010000:00010000:0.0:1789065958.823670:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065958.823678:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.823700:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf041683200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065958.823703:0:5827:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.823712:0:5827:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065958.823719:0:5827:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065958.823724:0:5827:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789065958.823727:0:5827:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789065958.823729:0:5827:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789065958.823761:0:5827:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:0.0:1789065958.823766:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.823772:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf041683200/0x7555615576c825e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c825ef expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.823785:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065958.823786:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065958.823788:0:5827:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065958.823806:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258016128:0@lo:400:kworker.0 00000100:00100000:2.0:1789065958.823833:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258016384:0@lo:400:kworker.0 00000100:00080000:1.0:1789065958.824309:0:13319:0:(import.c:65:import_set_state_nolock()) ffff9cf08164c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1789065958.824317:0:13319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789065958.824322:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70f800 x1875971258016000/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065966 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.824331:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70ea00 x1875971258016128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065971 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.824357:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70e680 x1875971258016384/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789065972 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.824365:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07b0b1500 x1875971258016512/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789065968 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789065958.824370:0:13319:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789065958.824376:0:13319:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 13s for inflight to error out 00000100:00100000:0.0:1789065958.824444:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258016000:0@lo:400:kworker.0 00000100:00100000:0.0:1789065958.824470:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3294:1875971258016512:0@lo:38:kworker.0 00010000:00010000:0.0:1789065958.828058:0:13319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828105:0:13319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828114:0:13319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828122:0:13319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828148:0:13319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789065958.828166:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065958.828174:0:6701:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828182:0:6701:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065958.828186:0:6701:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828196:0:6701:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065958.828204:0:6701:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065958.828210:0:6701:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789065958.828213:0:6701:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789065958.828228:0:6701:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:0.0:1789065958.828233:0:6701:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828251:0:6701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031200/0x7555615576c825f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c825fd expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828266:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065958.828268:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065958.828270:0:6701:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065958.828282:0:13319:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828291:0:13319:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828298:0:13319:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828306:0:13319:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065958.828322:0:13319:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789065958.828327:0:13319:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1789065958.828332:0:13319:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1789065958.828370:0:13319:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1789065958.828375:0:13319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1789065958.828380:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789065958.828386:0:13319:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789065958.828391:0:13319:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9cf074ea99c0) has no exports 00010000:00010000:2.0:1789065958.828415:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000020:00080000:0.0:1789065958.828417:0:13319:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff9cf074ea99c0) has no exports 00010000:00010000:2.0:1789065958.828423:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065958.828433:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1ca00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789065958.828437:0:5826:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065958.828445:0:5826:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065958.828452:0:5826:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065958.828458:0:5826:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789065958.828460:0:5826:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789065958.828462:0:5826:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789065958.828469:0:5826:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:2.0:1789065958.828473:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065958.828480:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1ca00/0x7555615576c8282d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82834 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065958.828493:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065958.828495:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789065958.828496:0:5826:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789065958.830597:0:13319:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf050d4f7e0 - data ffff9cf07f8a8a20/ffff9cf081658800 00000020:01000000:0.0:1789065958.830809:0:13319:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9cf06a651b40 - data ffff9cf07f8d95e8/ffff9cf080ffd000 00100000:10000000:0.0:1789065958.843938:0:13319:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789065958.905280:0:13319:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c824ec 00000020:00000080:2.0:1789065958.905299:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf07f17c800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789065958.905435:0:13319:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf081779000 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789065958.905439:0:13319:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf081779000 2 00000020:01000004:2.0:1789065958.905443:0:13319:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9cf081779000 from lustre-OST0001 00000020:00000080:2.0:1789065958.905469:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789065958.905479:0:13319:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789065958.905482:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf07f17a000/lustre-OST0001_UUID 00000020:00000080:2.0:1789065958.905485:0:13319:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17a000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789065958.905492:0:13319:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:2.0:1789065958.905644:0:13319:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 8c7529dd-e8b4-44e5-b83f-e77028f31a41->MGS 00010000:00010000:2.0:1789065958.905661:0:13319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065958.905672:0:13319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065958.905678:0:13319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789065958.905681:0:13319:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789065958.905684:0:13319:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789065958.905696:0:13319:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:2.0:1789065958.905699:0:13319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf040031400/0x7555615576c823fe lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82405 expref: -99 pid: 6683 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065958.905712:0:13319:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789065958.905718:0:13319:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789065958.905723:0:13319:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789065958.905726:0:13319:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789065958.905727:0:13319:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789065958.905742:0:13319:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9cf05084c000 00010000:00010000:2.0:1789065958.905745:0:13319:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf041683600/0x7555615576c8263c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x7555615576c82643 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789065958.905760:0:13319:0:(import.c:65:import_set_state_nolock()) ffff9cf05084c000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789065958.905764:0:13319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789065958.905766:0:13319:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789065958.905767:0:13319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789065958.905771:0:13319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789065958.905781:0:13319:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff9cf07f70c000 x1875971258016256/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789065971 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789065958.905792:0:13319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789065958.905806:0:13319:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000020:00000080:3.0:1789065958.906163:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf07f17c800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:0.0:1789065958.906180:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:8c7529dd-e8b4-44e5-b83f-e77028f31a41:3294:1875971258016256:0@lo:250:kworker.0 10000000:01000000:3.0:1789065958.906199:0:13319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789065958.906206:0:13319:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c822df 00000020:00000080:3.0:1789065958.906210:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf051772000/8c7529dd-e8b4-44e5-b83f-e77028f31a41 00000020:01000000:3.0:1789065958.906224:0:13319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.123@tcp (flags='') 00000020:00000080:3.0:1789065958.906229:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065958.906233:0:13319:0:(obd_config.c:956:class_cleanup()) MGC192.168.204.123@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1789065958.906237:0:13319:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff9cf0581e4d40) has no exports 10000000:01000000:3.0:1789065958.906254:0:5835:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1789065958.906298:0:13319:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.204.123@tcp: client import never connected 00000100:00080000:3.0:1789065958.906301:0:13319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1789065958.906303:0:13319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1789065958.906305:0:13319:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1789065958.906307:0:13319:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1789065958.906343:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065958.906348:0:13319:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.123@tcp (uuid 8c7529dd-e8b4-44e5-b83f-e77028f31a41) 00000020:01000000:3.0:1789065958.906353:0:13319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1789065958.906357:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065958.906360:0:13319:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789065958.906374:0:13319:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9cf081648000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789065958.906380:0:13319:0:(genops.c:1552:class_disconnect_exports()) OBD device 16 (ffff9cf081664d40) has exports, disconnecting them 00000020:00080000:3.0:1789065958.906384:0:13319:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9cf081648000), last request at 1789065722 00000020:00000080:3.0:1789065958.906387:0:13319:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c82516 00000020:00080000:3.0:1789065958.906397:0:13319:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff9cf081648000): rc 0 00000020:00000080:3.0:1789065958.906401:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf081648000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789065958.907239:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf051772000/8c7529dd-e8b4-44e5-b83f-e77028f31a41 for MGC192.168.204.123@tcp 00000020:00000080:0.0:1789065958.907253:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf05084c000 for MGC192.168.204.123@tcp 00000020:00000080:0.0:1789065958.907259:0:8:0:(genops.c:885:class_export_put()) final put ffff9cf05084e000/8c7529dd-e8b4-44e5-b83f-e77028f31a41 00000020:00000080:0.0:1789065958.907261:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf05084e000/8c7529dd-e8b4-44e5-b83f-e77028f31a41 for MGC192.168.204.123@tcp 00000020:01000000:0.0:1789065958.907265:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.123@tcp (8c7529dd-e8b4-44e5-b83f-e77028f31a41) 00000020:00000080:0.0:1789065958.907521:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf081648000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789065958.907588:0:13319:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789065958.907593:0:13319:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789065958.907596:0:13319:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789065958.907602:0:13319:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789065958.907623:0:8:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff9cf08164c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1789065958.907647:0:5827:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:0.0:1789065958.908491:0:6701:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:0.0:1789065958.908737:0:5826:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:0.0:1789065958.909798:0:5822:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9cf065ed0200:5822] 1 exiting: rc = 0 00000100:00100000:0.0:1789065958.910369:0:5821:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9cf04320ea00:5821] 0 exiting: rc = 1 00000100:00100000:2.0:1789065958.910468:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.910708:0:8446:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9cf07eeca000:8446] 3 exiting: rc = 0 00000100:00100000:0.0:1789065958.910917:0:5823:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9cf065ed1600:5823] 0 exiting: rc = 1 00000100:00100000:0.0:1789065958.911186:0:5824:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9cf0435f5c00:5824] 1 exiting: rc = 0 00000100:00100000:0.0:1789065958.911240:0:5825:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9cf0435f4400:5825] 2 exiting: rc = 0 00000100:00100000:2.0:1789065958.911282:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911289:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911295:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911301:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911307:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911312:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911317:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911322:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911328:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911346:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911352:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911358:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911364:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911378:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911396:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911402:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911410:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911415:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911420:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911425:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911430:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911435:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911439:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911445:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911450:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911456:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911461:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911466:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911471:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911476:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911481:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911487:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911492:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911497:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911503:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911509:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911514:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911520:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911525:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911530:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911535:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911540:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911565:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911572:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911577:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911582:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911586:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911591:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911595:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911607:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911612:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911617:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911622:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911626:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911631:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911636:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911641:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911645:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911650:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911655:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911660:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911664:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911670:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789065958.911675:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789065958.914078:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789065958.914091:0:13319:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:2.0:1789065958.914098:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf08164b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:2.0:1789065958.914103:0:13319:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf08164b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:2.0:1789065958.914109:0:13319:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:2.0:1789065958.914149:0:13319:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf081779000 1 00000020:00000080:2.0:1789065958.914155:0:13319:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x7555615576c824bb 00000020:00000080:2.0:1789065958.914160:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf044fdc000/lustre-OST0001-osd_UUID 00000020:01000000:2.0:1789065958.914180:0:13319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:2.0:1789065958.914184:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789065958.914189:0:13319:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789065958.914193:0:13319:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff9cf074eacd40) has no exports 00000020:00000080:0.0:1789065958.914322:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf044fdc000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789065958.932178:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065958.932194:0:13319:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789065958.932214:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf08177a000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789065958.932219:0:13319:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf08177a000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789065958.932232:0:13319:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789065958.932455:0:13319:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9cf08177e800 00000020:01000000:3.0:1789065958.932479:0:13319:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789065958.932483:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789065958.932487:0:13319:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789065958.932491:0:13319:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff9cf06a510000) has no exports 00000020:00000080:3.0:1789065958.932516:0:13319:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789065958.932522:0:13319:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789065958.932525:0:13319:0:(genops.c:885:class_export_put()) final put ffff9cf0818e2800/OSS_uuid 00000020:00000080:3.0:1789065958.932528:0:13319:0:(genops.c:844:class_export_destroy()) destroying export ffff9cf0818e2800/OSS_uuid for OSS 00000020:01000000:3.0:1789065958.932531:0:13319:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1789065958.932637:0:6688:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff9cf08172d400:6688] 2 exiting: rc = 0 00000100:00100000:3.0:1789065958.932721:0:6685:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff9cf065c6ba00:6685] 0 exiting: rc = 1 00000100:00100000:3.0:1789065958.932773:0:6880:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff9cf050c30c00:6880] 3 exiting: rc = 0 00000100:00080000:1.0:1789065958.933716:0:5834:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789065958.933825:0:6687:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff9cf065c6ac00:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1789065958.933888:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933898:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933905:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933911:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933916:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933922:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933926:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933932:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933938:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933943:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933948:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933953:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933958:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933963:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933968:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933974:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933979:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933984:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933990:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.933995:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934000:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934006:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934011:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934017:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934033:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934038:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934044:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934049:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934054:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934060:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934065:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934070:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934075:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934081:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934086:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934092:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934097:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934102:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934108:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934113:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934118:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934123:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934128:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934133:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934139:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934145:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934150:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934155:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934160:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934166:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934172:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934177:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934182:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934187:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934192:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934197:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934202:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934208:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934213:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934227:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934232:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934238:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934244:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.934249:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935009:0:6689:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9cf0816c5000:6689] 0 exiting: rc = 1 00000100:00100000:0.0:1789065958.935773:0:6690:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9cf050c32a00:6690] 1 exiting: rc = 0 00000100:00100000:1.0:1789065958.935912:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935923:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935930:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935935:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935940:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935946:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935952:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935957:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935962:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935969:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935974:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935980:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935985:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935990:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.935996:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936001:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936007:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936012:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936018:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936023:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936029:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936033:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936039:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936044:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936049:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936055:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936060:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936065:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936069:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936083:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936100:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936106:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936111:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936116:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936121:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936126:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936131:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936136:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936141:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936146:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936151:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936157:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936161:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936167:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936171:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936176:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936180:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936185:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936189:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936194:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936198:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936203:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936208:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936212:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936217:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936221:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936230:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936236:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936242:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936246:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936251:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936256:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936261:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.936266:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065958.939380:0:6692:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9cf06a536600:6692] 1 exiting: rc = 0 00000100:00100000:1.0:1789065958.939711:0:6693:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9cf050c33000:6693] 2 exiting: rc = 0 00000100:00100000:0.0:1789065958.939987:0:6691:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9cf06a536200:6691] 0 exiting: rc = 1 00000100:00100000:1.0:1789065958.940134:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940143:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940149:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940156:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940162:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940169:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940175:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940180:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940186:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940192:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940197:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940203:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940209:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940232:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940241:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940247:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940253:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940263:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940272:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940278:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940284:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940291:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940297:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940644:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940653:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940661:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940667:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940674:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940680:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940687:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940693:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940699:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940706:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940711:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940729:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940734:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940740:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940760:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940766:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940772:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940778:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940783:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940789:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940795:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940803:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940809:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940815:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940821:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940827:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940833:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940839:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940844:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940850:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940855:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940862:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940868:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940874:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940880:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940886:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940892:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940898:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940904:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940910:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.940928:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.948681:0:6695:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9cf050c33400:6695] 1 exiting: rc = 0 00000100:00100000:3.0:1789065958.948817:0:6694:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9cf050c33c00:6694] 0 exiting: rc = 1 00000100:00100000:1.0:1789065958.949313:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949321:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949327:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949343:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949365:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949371:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949383:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949390:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949395:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949401:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949407:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949412:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949417:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949422:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949428:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949433:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949439:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949444:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949449:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949454:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949459:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949465:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949470:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949476:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949481:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949487:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949493:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949498:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949504:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949510:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949516:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949521:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949527:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949532:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949539:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949545:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949582:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949587:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949592:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949605:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949611:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949616:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949622:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949627:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949632:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949638:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949643:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949648:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949653:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949658:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949664:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949669:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949675:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949680:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949686:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949692:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949697:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949702:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949707:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949713:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949718:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949723:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949728:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.949733:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789065958.950605:0:6696:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9cf080ff2200:6696] 0 exiting: rc = 1 00000100:00100000:0.0:1789065958.950746:0:6697:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9cf080ff3800:6697] 1 exiting: rc = 0 00000100:00100000:1.0:1789065958.951081:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951088:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951097:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951103:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951109:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951115:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951120:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951128:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951135:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951151:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951172:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951180:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951186:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951192:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951198:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951220:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951227:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951233:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951240:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951246:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951252:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951258:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951263:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951269:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951275:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951280:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951285:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951399:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951408:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951413:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951419:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951424:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951431:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951436:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951442:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951448:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951453:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951460:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951465:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951485:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951493:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951499:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951505:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951513:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951518:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951532:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951538:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951544:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951578:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951583:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951590:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951612:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951620:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951626:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951632:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951639:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951645:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951651:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951658:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951664:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951671:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951676:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951682:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789065958.951687:0:13319:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789065958.963223:0:13319:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1789065982.030997:0:13934:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789065991.925280:0:14394:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789065991.925286:0:14394:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1789065991.925406:0:14394:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf07f2f7000 00000020:01000004:3.0:1789065991.925423:0:14394:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789065991.925440:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1789065991.925455:0:14394:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9cf074eacd40) 00000020:00000080:3.0:1789065991.925469:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789065991.954007:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789065991.956105:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789065991.958254:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 280: rc = 0 00100000:10000000:0.0:1789065991.958492:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789065991.958616:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 280: rc = 0 00100000:10000000:0.0:1789065991.959676:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 280: rc = 0 00100000:10000000:0.0:1789065991.960210:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 280: rc = 0 00100000:10000000:0.0:1789065991.960310:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 280: rc = 0 00100000:10000000:0.0:1789065991.960402:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 280: rc = 0 00100000:10000000:0.0:1789065991.961103:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 282: rc = 0 00100000:10000000:0.0:1789065991.963444:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 625: rc = 0 00100000:10000000:0.0:1789065991.963724:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 625: rc = 0 00100000:10000000:0.0:1789065991.965098:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1789065991.965345:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1789065991.966121:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 301: rc = 0 00100000:10000000:0.0:1789065991.966372:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 301: rc = 0 00100000:10000000:0.0:1789065991.966982:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 301: rc = 0 00100000:10000000:0.0:1789065991.967296:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1789065991.967735:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1789065991.968143:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 301: rc = 0 00100000:10000000:0.0:1789065991.968419:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 301: rc = 0 00100000:10000000:0.0:1789065991.968914:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 301: rc = 0 00100000:10000000:0.0:1789065991.969234:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1789065991.969616:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 301: rc = 0 00100000:10000000:0.0:1789065991.970227:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 770: rc = 0 00100000:10000000:0.0:1789065991.970489:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 770: rc = 0 00100000:10000000:0.0:1789065991.970983:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 770: rc = 0 00100000:10000000:0.0:1789065991.971307:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 770: rc = 0 00100000:10000000:0.0:1789065991.971723:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 770: rc = 0 00100000:10000000:0.0:1789065991.972080:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 770: rc = 0 00100000:10000000:0.0:1789065991.972321:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 770: rc = 0 00100000:10000000:0.0:1789065991.972730:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 770: rc = 0 00100000:10000000:0.0:1789065991.973048:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 770: rc = 0 00100000:10000000:0.0:1789065991.973285:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 770: rc = 0 00100000:10000000:0.0:1789065991.973724:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 770: rc = 0 00100000:10000000:0.0:1789065991.974053:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 770: rc = 0 00100000:10000000:0.0:1789065991.974302:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 770: rc = 0 00100000:10000000:0.0:1789065991.974724:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 770: rc = 0 00100000:10000000:0.0:1789065991.975046:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 770: rc = 0 00100000:10000000:0.0:1789065991.975278:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 770: rc = 0 00100000:10000000:0.0:1789065991.975745:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 770: rc = 0 00100000:10000000:0.0:1789065991.976083:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 770: rc = 0 00100000:10000000:0.0:1789065991.976307:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 770: rc = 0 00100000:10000000:0.0:1789065991.976643:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 770: rc = 0 00100000:10000000:0.0:1789065991.976971:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 770: rc = 0 00100000:10000000:0.0:1789065991.977211:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 770: rc = 0 00100000:10000000:0.0:1789065991.977939:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 770: rc = 0 00100000:10000000:0.0:1789065991.978205:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 770: rc = 0 00100000:10000000:0.0:1789065991.978831:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 770: rc = 0 00100000:10000000:0.0:1789065991.979085:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 770: rc = 0 00100000:10000000:0.0:1789065991.979317:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 770: rc = 0 00100000:10000000:0.0:1789065991.980897:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 770: rc = 0 00100000:10000000:0.0:1789065991.983820:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 770: rc = 0 00100000:10000000:0.0:1789065991.984233:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 770: rc = 0 00100000:10000000:0.0:1789065991.984472:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 770: rc = 0 00100000:10000000:0.0:1789065991.984998:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 770: rc = 0 00100000:10000000:0.0:1789065991.985410:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 631: rc = 0 00100000:10000000:0.0:1789065991.986277:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:0.0:1789065991.986455:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 298: rc = 0 00100000:10000000:0.0:1789065991.987502:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789065991.987715:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 298: rc = 0 00100000:10000000:2.0:1789065991.987945:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789065991.988027:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 298: rc = 0 00100000:10000000:2.0:1789065991.988380:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789065991.988446:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 626: rc = 0 00100000:10000000:2.0:1789065991.991064:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789065991.991142:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 626: rc = 0 00100000:10000000:2.0:1789065991.991316:0:14394:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789065991.991371:0:14394:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 626: rc = 0 00000020:00000080:2.0:1789065991.991641:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789065991.991648:0:14394:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789065991.991658:0:14394:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c835d2 00000020:01000004:2.0:1789065991.991665:0:14394:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789065991.991669:0:14394:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789065991.991674:0:14394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf07f2f7000 from MGS 00000020:01000004:2.0:1789065991.991677:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789065991.991686:0:14394:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9cf081664d40) 00000020:00000080:2.0:1789065991.991694:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789065991.991759:0:14394:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07f2f7000 from MGS, refs=2 00080000:01000000:2.0:1789065991.991764:0:14394:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789065991.991769:0:14394:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c835e0 00000100:00100000:2.0:1789065991.991851:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789065991.991978:0:14394:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789065991.991984:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789065991.995662:0:14394:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789065991.995687:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789065991.996721:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065991.997069:0:14394:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789065991.997075:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789065991.998537:0:14394:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789065991.998573:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789065992.003536:0:14394:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789065992.003578:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1789065992.013457:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.013463:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.013465:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.017067:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.017073:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.017076:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.018070:0:14394:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789065992.020502:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789065992.039135:0:14394:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789065992.039154:0:14394:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789065992.039158:0:14394:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789065992.056460:0:14404:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789065992.057131:0:14394:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789065992.057260:0:14394:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789065992.058194:0:14394:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789065992.059090:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789065992.059269:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789065992.059276:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789065992.074142:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789065992.074157:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789065992.075462:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789065992.075473:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789065992.076401:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789065992.076423:0:14394:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.123@tcp' 00000020:01000004:3.0:1789065992.076425:0:14394:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789065992.076457:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.123@tcp (typ=mgc) 00000020:00000080:3.0:1789065992.076470:0:14394:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.123@tcp (ffff9cf074ea99c0) 00000020:00000080:3.0:1789065992.076485:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789065992.080057:0:14394:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf07f2f3000@MGC192.168.204.123@tcp: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1789065992.080245:0:14394:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.123@tcp-0 is initialized 00000040:01000000:3.0:1789065992.080253:0:14394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 1 is initialized 00000100:00080000:1.0:1789065992.082518:0:14408:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1789065992.083957:0:14409:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789065992.084251:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.123@tcp (uuid 82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e) 00000020:00000080:2.0:1789065992.084275:0:14394:0:(genops.c:1384:class_connect()) connect: client 82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e, cookie 0x7555615576c835ee 00000100:00080000:2.0:1789065992.084289:0:14394:0:(import.c:545:import_select_connection()) MGC192.168.204.123@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789065992.084300:0:14394:0:(import.c:666:import_select_connection()) MGC192.168.204.123@tcp: import ffff9cf07f2f3000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065992.084338:0:14394:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433b9880 x1875971258016640/t0(0) o250->MGC192.168.204.123@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789065992.084369:0:14394:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e->MGS 00000100:00100000:0.0:1789065992.084439:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3294:1875971258016640:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789065992.084501:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.084583:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258016640 00000100:00100000:0.0:1789065992.084590:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258016640 00000100:00100000:0.0:1789065992.084620:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065992.084627:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3294:x1875971258016640:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789065992.084647:0:14405:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e@0@lo t0 exp 0000000000000000 cur 451 last 0 00000020:00000080:0.0:1789065992.084682:0:14405:0:(genops.c:1384:class_connect()) connect: client 82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e, cookie 0x7555615576c835f5 00000100:00080000:0.0:1789065992.086132:0:14405:0:(import.c:65:import_set_state_nolock()) ffff9cf05f2e8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789065992.086209:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+5:3294:x1875971258016640:12345-0@lo:250:mount.lustre.0 Request processed in 1580us (1706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.086218:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065992.086267:0:3294:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.204.123@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789065992.086275:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.204.123@tcp: connect to target with instance 0 00000100:00080000:0.0:1789065992.086283:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.204.123@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789065992.086288:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789065992.086301:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07f2f3000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789065992.086303:0:3294:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789065992.086313:0:3294:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789065992.086318:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3294:1875971258016640:0@lo:250:mount.lustre.0 00000020:01000004:2.0:1789065992.087112:0:14394:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789065992.087130:0:14394:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789065992.087145:0:14394:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9cf0816619c0) 00000020:00000080:2.0:1789065992.087161:0:14394:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1789065992.095572:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065992.095807:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789065992.095813:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1789065992.100686:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1789065992.100711:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1789065992.101030:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1789065992.101036:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1789065992.104442:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065992.104616:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1789065992.104622:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1789065992.105436:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1789065992.105444:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789065992.147485:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065992.147693:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789065992.147709:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789065992.151116:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789065992.151131:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789065992.153391:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789065992.153687:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789065992.153693:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1789065992.154815:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789065992.154824:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789065992.155729:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065992.155927:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789065992.155933:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789065992.160109:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789065992.160123:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789065992.161089:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065992.163779:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789065992.163790:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1789065992.164492:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789065992.164498:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1789065992.219635:0:14394:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789065992.220337:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1789065992.220355:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1789065992.223903:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789065992.223921:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789065992.228810:0:14394:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789065992.228829:0:14394:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1789065992.231477:0:14394:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1789065992.231503:0:14394:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1789065992.231509:0:14394:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1789065992.231883:0:14394:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789065992.231926:0:14394:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1789065992.231931:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789065992.231933:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065992.231935:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065992.231936:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065992.231938:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065992.231939:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065992.231953:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065992.231954:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065992.231956:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065992.231957:0:14394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789065992.231960:0:14394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1789065992.231962:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789065992.231963:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065992.231965:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065992.231966:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065992.231967:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065992.231968:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065992.231969:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065992.231970:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065992.231971:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065992.231972:0:14394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789065992.232001:0:14394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789065992.232030:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258016768:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789065992.232100:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.232153:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065992.235533:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258016768 00000100:00100000:2.0:1789065992.235579:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258016768 00000100:00100000:2.0:1789065992.235643:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789065992.235655:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+5:14394:x1875971258016768:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789065992.235713:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789065992.235722:0:14407:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789065992.235725:0:14407:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789065992.236897:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789065992.237309:0:14407:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1789065992.238733:0:14429:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789065992.238742:0:14429:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789065992.238745:0:14429:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789065992.238784:0:14429:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789065992.239165:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789065992.239175:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789065992.267386:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+5:14394:x1875971258016768:12345-0@lo:253:mount.lustre.0 Request processed in 31722us (35275us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065992.267406:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789065992.267488:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258016768:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789065992.267502:0:14394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789065992.267506:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789065992.267508:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065992.267509:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065992.267510:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065992.267512:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065992.267513:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065992.267514:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065992.267516:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065992.267517:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065992.267519:0:14394:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789065992.267737:0:14394:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf07f2f7000 from lustre-MDT0000 10000000:01000000:0.0:1789065992.267767:0:14394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789065992.267770:0:14394:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789065992.267774:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9cf074ea99c0 10000000:01000000:0.0:1789065992.267778:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789065992.267786:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9cf074ea99c0 from 1 10000000:01000000:0.0:1789065992.267789:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789065992.267827:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.267839:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.267848:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.267869:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258016896:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789065992.267933:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.268084:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535c89c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789065992.268136:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258016896 00000100:00100000:1.0:1789065992.268142:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258016896 00000100:00100000:1.0:1789065992.268216:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789065992.268225:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+5:14394:x1875971258016896:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789065992.268236:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065992.268250:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a7800/0x7555615576c8360a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83603 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.268271:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a7800/0x7555615576c8360a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83603 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.268281:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a7800/0x7555615576c8360a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83603 expref: 6 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.268290:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7800, rc 0) 00000100:00100000:1.0:1789065992.268331:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+6:14394:x1875971258016896:12345-0@lo:101:mount.lustre.0 Request processed in 107us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065992.268337:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789065992.268404:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258016896:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.268418:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.268427:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.268468:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017024:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.268503:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.268612:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535c89c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789065992.269158:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258017024 00000100:00100000:3.0:1789065992.269164:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258017024 00000100:00100000:3.0:1789065992.269193:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789065992.269200:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+6:14394:x1875971258017024:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789065992.269429:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+6:14394:x1875971258017024:12345-0@lo:501:mount.lustre.0 Request processed in 229us (925us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789065992.269437:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789065992.269544:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017024:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789065992.269588:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789065992.269606:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269615:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065992.269623:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf07f2f7000 10000000:01000000:0.0:1789065992.269628:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789065992.269632:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9cf07f2f7000 10000000:01000000:0.0:1789065992.269634:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1789065992.269637:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9cf07f2f7000 from 1 10000000:01000000:0.0:1789065992.269640:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1789065992.269661:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269685:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269694:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.269718:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789065992.269745:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.269769:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258017152 00000100:00100000:0.0:1789065992.269773:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258017152 00000100:00100000:0.0:1789065992.269790:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789065992.269796:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+6:14394:x1875971258017152:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.269804:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065992.269817:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07b048600/0x7555615576c83618 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83611 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269833:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b048600/0x7555615576c83618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83611 expref: 7 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269844:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07b048600/0x7555615576c83618 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83611 expref: 7 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269852:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b048600, rc 0) 00000100:00100000:0.0:1789065992.269874:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+7:14394:x1875971258017152:12345-0@lo:101:mount.lustre.0 Request processed in 78us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.269880:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789065992.269910:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.269929:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.269939:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83618 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269947:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83618 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065992.269958:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1789065992.269962:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83618 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.269968:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b049e00/0x7555615576c83611 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83618 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065992.269973:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789065992.269976:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789065992.269980:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9cf07f2f7000 10000000:01000000:0.0:1789065992.269982:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1789065992.269985:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1789065992.269987:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789065992.269999:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.270018:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.270025:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.270035:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017280:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789065992.270064:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.270082:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258017280 00000100:00100000:0.0:1789065992.270086:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258017280 00000100:00100000:0.0:1789065992.270101:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789065992.270106:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+7:14394:x1875971258017280:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.270113:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065992.270120:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07b048a00/0x7555615576c83626 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8361f expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.270133:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b048a00/0x7555615576c83626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8361f expref: 8 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.270141:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07b048a00/0x7555615576c83626 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8361f expref: 8 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.270148:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b048a00, rc 0) 00000100:00100000:0.0:1789065992.270170:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+8:14394:x1875971258017280:12345-0@lo:101:mount.lustre.0 Request processed in 64us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.270176:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789065992.270197:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.270208:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017280:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.270218:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83626 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.270225:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83626 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.270261:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.270293:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.270312:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258017408 00000100:00100000:0.0:1789065992.270315:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258017408 00000100:00100000:0.0:1789065992.270330:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065992.270336:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+8:14394:x1875971258017408:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.270647:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14394:x1875971258017408:12345-0@lo:501:mount.lustre.0 Request processed in 310us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.270655:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789065992.270676:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.270688:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017408:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.270724:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017536:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789065992.270762:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.270784:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258017536 00000100:00100000:0.0:1789065992.270788:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258017536 00000100:00100000:0.0:1789065992.270805:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065992.270812:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14394:x1875971258017536:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789065992.271086:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14394:x1875971258017536:12345-0@lo:503:mount.lustre.0 Request processed in 275us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.271093:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789065992.271123:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535c89c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.271136:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258017536:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789065992.272088:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14430:1875971258017664:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065992.272134:0:14430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065992.272199:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0412ede40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.272229:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258017664 00000100:00100000:0.0:1789065992.272235:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258017664 00000100:00100000:0.0:1789065992.272297:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789065992.272305:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14430:x1875971258017664:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065992.272806:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14430:x1875971258017664:12345-0@lo:502:llog_process_th.0 Request processed in 501us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.272814:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789065992.272897:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14430:1875971258017664:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065992.272924:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065992.272935:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.272937:0:14430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789065992.272943:0:14430:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1789065992.272946:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789065992.272961:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9cf050e9b380) 00000020:00000080:1.0:1789065992.272978:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1789065992.272985:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789065992.273069:0:14430:0:(osd_handler.c:1574:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789065992.273077:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c83634 00000020:00000080:1.0:1789065992.273276:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1789065992.273280:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065992.273283:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.273285:0:14430:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1789065992.273287:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065992.273290:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.273292:0:14430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1789065992.273295:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789065992.273301:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9cf050e999c0) 00000020:00000080:1.0:1789065992.273310:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1789065992.273313:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789065992.273315:0:14430:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1789065992.273317:0:14430:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1789065992.273323:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789065992.273365:0:14430:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07f2f7000 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1789065992.273376:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9cf050e9cd40) 00000020:00000080:1.0:1789065992.273383:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1789065992.273420:0:14430:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789065992.273424:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c83649 00000020:00000080:1.0:1789065992.273504:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1789065992.273509:0:14430:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789065992.273512:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x7555615576c83650 00080000:01000000:1.0:1789065992.273516:0:14430:0:(osd_handler.c:1574:osd_obd_connect()) connect #3 00000020:00000080:1.0:1789065992.273519:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c83657 00010000:00010000:1.0:1789065992.396511:0:14430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1789065992.397821:0:14430:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1789065992.399232:0:14430:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1789065992.401760:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9cf050e98000) 00000020:00000080:1.0:1789065992.401785:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1789065992.401867:0:14430:0:(osd_handler.c:1574:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789065992.403752:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c83665 00000020:00000080:2.0:1789065992.404879:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789065992.415622:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x7555615576c8366c 00000020:00000080:2.0:1789065992.417825:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1789065992.417839:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065992.417847:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.417849:0:14430:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1789065992.417854:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789065992.417857:0:14430:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:2.0:1789065992.417859:0:14430:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789065992.417860:0:14430:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789065992.417862:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789065992.417865:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.417866:0:14430:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789065992.417869:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789065992.417874:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.417875:0:14430:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1789065992.417880:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1789065992.417925:0:14430:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1789065992.418030:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065992.418034:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.418036:0:14430:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1789065992.418038:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789065992.418042:0:14430:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789065992.418050:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.418051:0:14430:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1789065992.418056:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789065992.418061:0:14430:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:2.0:1789065992.418085:0:14430:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789065992.418088:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789065992.418104:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9cf081660000) 00000020:00000080:2.0:1789065992.418119:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1789065992.418124:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789065992.418177:0:14430:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1789065992.418183:0:14430:0:(osd_handler.c:1574:osd_obd_connect()) connect #5 00000020:00000080:2.0:1789065992.418189:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c8367a 00010000:00080000:2.0:1789065992.418219:0:14430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf073881000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065992.418443:0:14430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:2.0:1789065992.419126:0:14430:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789065992.419177:0:14430:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789065992.422046:0:14430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789065992.422116:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:2.0:1789065992.422185:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1789065992.424159:0:14435:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789065992.424166:0:14435:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1789065992.425367:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789065992.425380:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789065992.425412:0:14430:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1789065992.425431:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c83681 00000100:00080000:2.0:1789065992.425440:0:14430:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789065992.425453:0:14430:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf073881000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065992.425507:0:14430:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433baa00 x1875971258017792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789065992.426165:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258017792:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789065992.426221:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875971258017792 offset 0 length 520: 4 00000100:00080000:2.0:1789065992.426325:0:14430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1789065992.427490:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065992.427498:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.427511:0:14430:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1789065992.427515:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789065992.427518:0:14430:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1789065992.427520:0:14430:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789065992.427521:0:14430:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789065992.427523:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789065992.427526:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.427528:0:14430:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789065992.427530:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789065992.427535:0:14430:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1789065992.427539:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.427541:0:14430:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1789065992.427544:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1789065992.427571:0:14430:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.204.123@tcp to nid 0x20000c0a8cc7b (192.168.204.123@tcp) 00000020:01000000:2.0:1789065992.427596:0:14430:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1789065992.427599:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789065992.427615:0:14430:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9cf081663380) 00000020:00000080:2.0:1789065992.427635:0:14430:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1789065992.427640:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1789065992.427915:0:14430:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1789065992.427921:0:14430:0:(osd_handler.c:1574:osd_obd_connect()) connect #6 00000020:00000080:2.0:1789065992.427928:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x7555615576c8368f 00010000:00080000:2.0:1789065992.427969:0:14430:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf07b233800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065992.428206:0:14430:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:2.0:1789065992.428399:0:14430:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789065992.428421:0:14430:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789065992.429094:0:14430:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789065992.429166:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1789065992.429236:0:14430:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789065992.430896:0:14437:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789065992.430903:0:14437:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789065992.431830:0:14430:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789065992.431846:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789065992.431899:0:14430:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789065992.431922:0:14430:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c83696 00000100:00080000:3.0:1789065992.431932:0:14430:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789065992.432069:0:14430:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf07b233800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789065992.432108:0:14430:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70d500 x1875971258017920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789065992.432176:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258017920:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789065992.432244:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875971258017920 offset 0 length 520: 4 00000100:00080000:3.0:1789065992.432351:0:14430:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789065992.432409:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065992.432414:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065992.432416:0:14430:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789065992.432419:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789065992.432423:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065992.432424:0:14430:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789065992.432427:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789065992.432430:0:14430:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789065992.432432:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065992.432434:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065992.432435:0:14430:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789065992.432438:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789065992.432440:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065992.432441:0:14430:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789065992.432444:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1789065992.432471:0:14430:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14430:1875971258018048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065992.432518:0:14430:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065992.432586:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018048 00000100:00100000:3.0:1789065992.432593:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018048 00000100:00100000:3.0:1789065992.432633:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789065992.432642:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14430:x1875971258018048:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065992.432793:0:14430:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cd180 going to sleep for 11 seconds 00000100:00100000:3.0:1789065992.435161:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14430:x1875971258018048:12345-0@lo:502:llog_process_th.0 Request processed in 2513us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065992.435350:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789065992.436200:0:14430:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14430:1875971258018048:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789065992.436248:0:14430:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789065992.436256:0:14430:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789065992.436258:0:14430:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789065992.436264:0:14430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1789065992.436721:0:14394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1789065992.436749:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789065992.436773:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83626 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.436784:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b048800/0x7555615576c8361f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83626 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789065992.436792:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf07f2f7000 from 1 10000000:01000000:1.0:1789065992.436795:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789065992.436841:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.436849:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.436858:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065992.436879:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018176:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789065992.436933:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065992.437317:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.437517:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018176 00000100:00100000:0.0:1789065992.437526:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018176 00000100:00100000:0.0:1789065992.437786:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789065992.437798:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+9:14394:x1875971258018176:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.437814:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789065992.437832:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8369d expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.437859:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8369d expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.437871:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8369d expref: 10 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.437880:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049c00, rc 0) 00000100:00100000:0.0:1789065992.437991:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+10:14394:x1875971258018176:12345-0@lo:101:mount.lustre.0 Request processed in 195us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.438021:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789065992.438306:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018176:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789065992.438325:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.438334:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.439362:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018304:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789065992.439436:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.439541:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526600 going to sleep for 11 seconds 00000100:00100000:3.0:1789065992.439753:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018304 00000100:00100000:3.0:1789065992.439761:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018304 00000100:00100000:3.0:1789065992.439827:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789065992.439836:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+10:14394:x1875971258018304:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789065992.439852:0:14407:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789065992.439859:0:14407:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789065992.439960:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+10:14394:x1875971258018304:12345-0@lo:256:mount.lustre.0 Request processed in 125us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065992.439969:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789065992.440046:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018304:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789065992.440888:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789065992.440907:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.440919:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065992.440928:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07f2f7000 from 1 10000000:01000000:0.0:1789065992.440930:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789065992.441122:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.441131:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.441140:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.441166:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789065992.441212:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.441510:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526600 going to sleep for 11 seconds 00000100:00100000:2.0:1789065992.441666:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018432 00000100:00100000:2.0:1789065992.441672:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018432 00000100:00100000:2.0:1789065992.441716:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789065992.441724:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+10:14394:x1875971258018432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789065992.441735:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789065992.441750:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c836ab expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065992.441771:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c836ab expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065992.441781:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836ab expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789065992.441789:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789065992.441863:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258018432:12345-0@lo:101:mount.lustre.0 Request processed in 140us (650us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065992.441869:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789065992.442251:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.442319:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.442329:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.442387:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.442423:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.442489:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526600 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.442503:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018560 00000100:00100000:0.0:1789065992.442507:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018560 00000100:00100000:2.0:1789065992.442545:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789065992.442570:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258018560:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789065992.443143:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258018560:12345-0@lo:501:mount.lustre.0 Request processed in 572us (717us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065992.443150:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789065992.443312:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018560:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789065992.443358:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789065992.443397:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065992.443474:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.443568:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018688 00000100:00100000:0.0:1789065992.443574:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018688 00000100:00100000:0.0:1789065992.443594:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789065992.443601:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258018688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789065992.443759:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258018688:12345-0@lo:503:mount.lustre.0 Request processed in 157us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.443766:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789065992.443854:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258018688:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789065992.444440:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14439:1875971258018816:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065992.444480:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065992.444511:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789065992.444581:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018816 00000100:00100000:2.0:1789065992.444593:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018816 00000100:00100000:2.0:1789065992.444618:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789065992.444625:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14439:x1875971258018816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065992.444843:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14439:x1875971258018816:12345-0@lo:502:llog_process_th.0 Request processed in 218us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789065992.444850:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789065992.444950:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14439:1875971258018816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789065992.444973:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065992.444982:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.444984:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789065992.445003:0:14439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf07f2f7000 00000020:00000080:1.0:1789065992.445006:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789065992.445014:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065992.445017:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.445018:0:14439:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789065992.445021:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065992.445023:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.445025:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789065992.445028:0:14439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf07f2f7000 00000020:00000080:1.0:1789065992.445031:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789065992.445091:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789065992.445094:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.445096:0:14439:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789065992.445099:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789065992.445101:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789065992.445102:0:14439:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789065992.445106:0:14439:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf07f2f7000 00000020:00000080:1.0:1789065992.445108:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789065992.445148:0:14439:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14439:1875971258018944:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789065992.445191:0:14439:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065992.445205:0:14439:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.446819:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258018944 00000100:00100000:0.0:1789065992.446831:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258018944 00000100:00100000:0.0:1789065992.446876:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789065992.446886:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14439:x1875971258018944:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065992.447151:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14439:x1875971258018944:12345-0@lo:502:llog_process_th.0 Request processed in 265us (1957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.447497:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789065992.447679:0:14439:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14439:1875971258018944:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789065992.447721:0:14439:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789065992.447728:0:14439:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789065992.447730:0:14439:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789065992.447735:0:14439:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1789065992.448000:0:14394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789065992.448022:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789065992.448051:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.448063:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065992.448108:0:14394:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789065992.448112:0:14394:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf07f2f7000 10000000:01000000:0.0:1789065992.448115:0:14394:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf07f2f7000 10000000:01000000:0.0:1789065992.448119:0:14394:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789065992.448124:0:14394:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf07f2f7000 from 1 10000000:01000000:0.0:1789065992.448127:0:14394:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789065992.448264:0:14394:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.448273:0:14394:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.448283:0:14394:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.448302:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019072:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789065992.448352:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.448765:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789065992.448980:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019072 00000100:00100000:1.0:1789065992.448987:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019072 00000100:00100000:1.0:1789065992.449030:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789065992.449039:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258019072:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789065992.449051:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065992.449066:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a7400/0x7555615576c836c0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c836b9 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.449088:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a7400/0x7555615576c836c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c836b9 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.449098:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a7400/0x7555615576c836c0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836b9 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065992.449107:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7400, rc 0) 00000100:00100000:1.0:1789065992.449150:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14394:x1875971258019072:12345-0@lo:101:mount.lustre.0 Request processed in 112us (797us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065992.449156:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789065992.449329:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019072:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789065992.449344:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836c0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.449353:0:14394:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c836c0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.449419:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.449444:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.449458:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.449471:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019200 00000100:00100000:0.0:1789065992.449474:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019200 00000100:00100000:0.0:1789065992.449502:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789065992.449508:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14394:x1875971258019200:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.453140:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14394:x1875971258019200:12345-0@lo:501:mount.lustre.0 Request processed in 3623us (3686us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.453156:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789065992.453236:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019200:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789065992.453291:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019328:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789065992.453346:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.453377:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.453394:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019328 00000100:00100000:0.0:1789065992.453401:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019328 00000100:00100000:0.0:1789065992.453443:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789065992.453453:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14394:x1875971258019328:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789065992.454395:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14394:x1875971258019328:12345-0@lo:503:mount.lustre.0 Request processed in 939us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.454407:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789065992.454475:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019328:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789065992.456118:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14442:1875971258019456:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789065992.457102:0:14442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789065992.457136:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07edd7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.457328:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019456 00000100:00100000:0.0:1789065992.457342:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019456 00000100:00100000:0.0:1789065992.457388:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789065992.457397:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14442:x1875971258019456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789065992.460333:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14442:x1875971258019456:12345-0@lo:502:llog_process_th.0 Request processed in 2927us (3223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.460346:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789065992.464973:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14442:1875971258019456:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789065992.465080:0:14442:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789065992.465107:0:14442:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9cf07c030000) 00000020:00000080:2.0:1789065992.465130:0:14442:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789065992.465382:0:14442:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07f2f7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789065992.465386:0:14442:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf07f2f7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789065992.465390:0:14442:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf07f2f7000 4 00010000:00080000:2.0:1789065992.465426:0:14442:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf073886800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789065992.468031:0:14442:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1789065992.470989:0:14442:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789065992.471036:0:14442:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789065992.471050:0:14442:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x7555615576c836ce 00000100:00080000:3.0:1789065992.471063:0:14442:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789065992.471078:0:14442:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cf073886800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789065992.471119:0:14442:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70df80 x1875971258019584/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789065992.471175:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971258019584:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789065992.471243:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065992.471308:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019584 00000100:00100000:3.0:1789065992.471315:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019584 00000100:00100000:3.0:1789065992.471361:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789065992.471367:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3294:x1875971258019584:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789065992.471419:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3294:x1875971258019584:12345-0@lo:38:llog_process_th.0 Request processed in 51us (176us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789065992.471426:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789065992.471456:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789065992.471464:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf073886800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789065992.471477:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789065992.471480:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971258019584:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789065992.471508:0:14442:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1789065992.475129:0:14442:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14442:1875971258019712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065992.475221:0:14442:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065992.475264:0:14442:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789065992.477285:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019712 00000100:00100000:3.0:1789065992.477304:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019712 00000100:00100000:3.0:1789065992.477357:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789065992.477367:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14442:x1875971258019712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789065992.483293:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14442:x1875971258019712:12345-0@lo:502:llog_process_th.0 Request processed in 5919us (8064us total) trans 0 rc 0/0 00000100:00100000:3.0:1789065992.483308:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789065992.484539:0:14442:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70df80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14442:1875971258019712:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789065992.484744:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789065992.484869:0:14394:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789065992.484887:0:14394:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789065992.484908:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836c0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.484919:0:14394:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b049200/0x7555615576c836b9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836c0 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789065992.485067:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789065992.485070:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065992.485072:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065992.485073:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065992.485075:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065992.485076:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065992.485077:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065992.485079:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065992.485081:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065992.485082:0:14394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789065992.485086:0:14394:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789065992.485088:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789065992.485090:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065992.485091:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065992.485092:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065992.485093:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065992.485094:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065992.485095:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065992.485096:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065992.485097:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065992.485103:0:14394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789065992.485125:0:14394:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789065992.485140:0:14394:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019840:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789065992.485260:0:14394:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.485293:0:14394:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f526540 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.485314:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019840 00000100:00100000:0.0:1789065992.485320:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019840 00000100:00100000:0.0:1789065992.485355:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065992.485364:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14394:x1875971258019840:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789065992.485394:0:14406:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789065992.485409:0:14406:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789065992.548460:0:14406:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789065992.548516:0:14406:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1789065992.552214:0:14428:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789065992.552226:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789065992.552249:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.552286:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8369d expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.552295:0:14428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.552336:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8369d expref: 12 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.552350:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8369d expref: 12 pid: 14406 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065992.552365:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14428:1875971258019968:0@lo:104: 00000100:00100000:3.0:1789065992.552428:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789065992.552475:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cd480 going to sleep for 11 seconds 00000100:00100000:0.0:1789065992.552923:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258019968 00000100:00100000:0.0:1789065992.552944:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258019968 00000100:00100000:0.0:1789065992.552997:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065992.553006:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14428:x1875971258019968:12345-0@lo:104: 00010000:00010000:0.0:1789065992.553020:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553079:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789065992.553085:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14428:x1875971258019968:12345-0@lo:104: Request processed in 80us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.553092:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1789065992.553114:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789065992.553120:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553127:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789065992.553132:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553170:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789065992.553179:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789065992.553185:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789065992.553212:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553219:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789065992.553237:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553244:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6200/0x7555615576c8369d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836a4 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553261:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.553263:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065992.553265:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789065992.553284:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789065992.553295:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258020096:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789065992.553340:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789065992.553388:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020096 00000100:00100000:0.0:1789065992.553391:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020096 00010000:00010000:0.0:1789065992.553408:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8369d expref: 13 pid: 14406 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789065992.553429:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065992.553441:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+13:3295:x1875971258020096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789065992.553451:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789065992.553457:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8369d expref: 13 pid: 14406 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553467:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8369d expref: 13 pid: 14406 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553481:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553487:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789065992.553499:0:14397:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001274059s 00010000:00010000:0.0:1789065992.553503:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553509:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553515:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553520:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553525:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789065992.553528:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553543:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553602:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065992.553612:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789065992.553642:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+13:3295:x1875971258020096:12345-0@lo:103:ldlm_bl.0 Request processed in 201us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789065992.553648:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789065992.553707:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258020096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789065992.554482:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07b049c00/0x7555615576c836a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8369d expref: 12 pid: 14406 timeout: 551 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789065992.554497:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14428:1875971258019968:0@lo:104: 00010000:00010000:3.0:1789065992.554519:0:14428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.554529:0:14428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.554536:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789065992.554542:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf081654c00/0x7555615576c836d5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065992.590337:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14394:x1875971258019840:12345-0@lo:253:mount.lustre.0 Request processed in 104964us (105067us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065992.590351:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789065992.590439:0:14394:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14394:1875971258019840:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789065992.590457:0:14394:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789065992.590461:0:14394:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789065992.590462:0:14394:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789065992.590464:0:14394:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789065992.590465:0:14394:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789065992.590466:0:14394:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789065992.590468:0:14394:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789065992.590469:0:14394:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789065992.590471:0:14394:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789065992.590473:0:14394:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789065992.590474:0:14394:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789065992.590491:0:14394:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1789065992.597653:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1789065992.597805:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1789065992.598028:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1789065992.598184:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1789065992.598681:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1789065992.598853:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1789065992.608949:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065992.609125:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1789065992.609759:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065992.610091:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1789065992.610935:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1789065992.611098:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:1.0:1789065992.638767:0:14394:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000020:00080000:1.0:1789065992.639620:0:14451:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000040:01000000:2.0:1789065992.639625:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789065992.639626:0:14451:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789065992.640209:0:14452:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789065992.640283:0:14452:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:2.0:1789065992.642875:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789065992.642999:0:14394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789065992.643732:0:14452:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789065992.643798:0:14452:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789065992.643802:0:14452:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:2.0:1789065992.643822:0:14394:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789065992.643831:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789065992.643977:0:14394:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789065992.645618:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789065992.646066:0:14394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789065992.646090:0:14394:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:2.0:1789065992.647299:0:14394:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789065992.652439:0:14394:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789065992.701644:0:14394:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789065992.701702:0:14394:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaa0481ca7988 00100000:10000000:1.0:1789065992.701710:0:14394:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1789065992.703461:0:14394:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789065992.703477:0:14394:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789065992.703510:0:14394:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=46 00000080:00000004:2.0:1789065992.703527:0:14394:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1789065993.062301:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789065993.513015:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789065994.021750:0:14409:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789065994.021757:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf07f2f7000 from 6 10000000:01000000:1.0:1789065994.021761:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789065994.021805:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.021817:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.021828:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065994.021854:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258020224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789065994.021915:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065994.021961:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789065994.021981:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020224 00000100:00100000:1.0:1789065994.021994:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020224 00000100:00100000:1.0:1789065994.022036:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789065994.022044:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14409:x1875971258020224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065994.022056:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789065994.022069:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c836dc expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.022092:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c836dc expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.022103:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836dc expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.022113:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7a00, rc 0) 00000100:00100000:1.0:1789065994.022150:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258020224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 105us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065994.022157:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789065994.022204:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258020224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789065994.022217:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.022226:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789065994.022278:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258020352:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789065994.022308:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065994.022322:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04609c480 going to sleep for 11 seconds 00000100:00100000:1.0:1789065994.022335:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020352 00000100:00100000:1.0:1789065994.022344:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020352 00000100:00100000:1.0:1789065994.022365:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789065994.022371:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258020352:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789065994.022384:0:14406:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789065994.022400:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789065994.022403:0:14406:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1789065994.022477:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258020352:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 105us (168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065994.022484:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789065994.022514:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258020352:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789065994.022574:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789065994.022581:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789065994.022590:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789065994.089839:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789065994.546456:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789065995.110699:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789065996.134741:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065997.157761:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789065997.479892:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789065997.479899:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789065997.479902:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789065997.479905:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789065997.479908:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1789065997.479911:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1789065997.479915:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cf073886800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789065997.479931:0:38:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9cf073886800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789065997.479954:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433ba680 x1875971258020608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789065997.479995:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789065997.480006:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3298:1875971258020480:0@lo:400:kworker.0 00000100:00100000:1.0:1789065997.480275:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971258020608:0@lo:38:kworker.0 00000100:00100000:1.0:1789065997.480339:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065997.480419:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020608 00000100:00100000:1.0:1789065997.480427:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020608 00000100:00100000:1.0:1789065997.480461:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789065997.480469:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3294:x1875971258020608:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789065997.480496:0:14414:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 456 last 0 00000020:00000080:1.0:1789065997.480536:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x7555615576c836ea 00000004:00100000:1.0:1789065997.480579:0:14414:0:(mdt_handler.c:7356:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789065997.480811:0:14414:0:(import.c:65:import_set_state_nolock()) ffff9cf04589d000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789065997.480864:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3294:x1875971258020608:12345-0@lo:38:kworker.0 Request processed in 394us (524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065997.480873:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789065997.480915:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cef433ba680 x1875971258020608/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789066007 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789065997.480930:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789065997.480938:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789065997.480943:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789065997.480945:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf073886800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789065997.480951:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3294:1875971258020608:0@lo:38:kworker.0 00000100:00100000:2.0:1789065997.481312:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789065997.482130:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020480 00000100:00100000:1.0:1789065997.482141:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020480 00000100:00100000:1.0:1789065997.482217:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789065997.482226:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:3298:x1875971258020480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789065997.482289:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:3298:x1875971258020480:12345-0@lo:400:kworker.0 Request processed in 64us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1789065997.482295:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789065997.482351:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3298:1875971258020480:0@lo:400:kworker.0 00000001:02000400:3.0:1789065997.952972:0:14694:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789065998.183798:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789065999.210012:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066000.233402:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066001.269247:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789066002.212687:0:14845:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe7142d0d0 20000000:00000080:2.0:1789066002.212706:0:14845:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf07ee80800 uarg=0000000000000000 20000000:01000000:2.0:1789066002.212741:0:14845:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789066002.212748:0:14845:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789066002.212753:0:14845:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789066002.216488:0:14846:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:2.0:1789066002.216964:0:14845:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789066002.230894:0:14845:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789066002.231779:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.231805:0:14845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836ab expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.231813:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.231871:0:14845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c836ab expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.231890:0:14845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c836ab expref: 11 pid: 14405 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066002.231905:0:14845:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14845:1875971258020736:0@lo:104: 00000100:00100000:3.0:1789066002.235335:0:14845:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066002.235404:0:14845:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0460ddd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066002.235925:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020736 00000100:00100000:1.0:1789066002.235935:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020736 00000100:00100000:1.0:1789066002.235986:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789066002.236009:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14845:x1875971258020736:12345-0@lo:104: 00010000:00010000:1.0:1789066002.236026:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066002.236127:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789066002.236135:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14845:x1875971258020736:12345-0@lo:104: Request processed in 128us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066002.236143:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789066002.236284:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066002.236293:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.236300:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789066002.236304:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.236324:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789066002.236332:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789066002.236339:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789066002.236386:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.236393:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789066002.236426:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.236433:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf07b048200/0x7555615576c836ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836b2 expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.236450:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066002.236452:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066002.236454:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789066002.236471:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789066002.236485:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3297:1875971258020864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789066002.236628:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066002.236856:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020864 00000100:00100000:0.0:1789066002.236863:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020864 00010000:00010000:0.0:1789066002.236893:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c836ab expref: 12 pid: 14405 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066002.236917:0:14845:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14845:1875971258020736:0@lo:104: 00000100:00100000:0.0:1789066002.236949:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1789066002.236950:0:14845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066002.236959:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:3297:x1875971258020864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789066002.236973:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066002.236979:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c836ab expref: 12 pid: 14405 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.236991:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c836ab expref: 12 pid: 14405 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237004:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1c000/0x7555615576c836b2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c836ab expref: 12 pid: 14405 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237019:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237028:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237047:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237055:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237062:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237069:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237085:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066002.237089:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237096:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237117:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066002.237127:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066002.237184:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:3297:x1875971258020864:12345-0@lo:103:ldlm_bl.0 Request processed in 226us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066002.237192:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789066002.237222:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3297:1875971258020864:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789066002.237315:0:14845:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066002.237324:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066002.237330:0:14845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07fd1d400/0x7555615576c836f1 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066002.279290:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789066002.597765:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066002.597780:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789066002.597784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066002.597788:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789066002.597961:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258020992:0@lo:400:kworker.0 00000100:00100000:1.0:1789066002.597985:0:3294:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789065992/real 1789065992] req@ffff9cf07f70d500 x1875971258017920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066002.598017:0:3294:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cf07f70d500 x1875971258017920/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066002.598027:0:3294:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789065992/real 1789065992] req@ffff9cef433baa00 x1875971258017792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066002.598842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066002.599895:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258020992 00000100:00100000:2.0:1789066002.599929:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258020992 00000100:00100000:2.0:1789066002.600046:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789066002.600059:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258020992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789066002.600181:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258020992:12345-0@lo:400:kworker.0 Request processed in 125us (1342us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066002.600188:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789066002.601880:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cef433bb800 x1875971258020992/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066002.601901:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258020992:0@lo:400:kworker.0 00000100:00100000:1.0:1789066002.603544:0:3294:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cef433baa00 x1875971258017792/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789066002.603584:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789066002.603669:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789066002.603674:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258017920:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789066002.603681:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf073881000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789066002.615890:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066002.615901:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789066002.615906:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf073881000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789066002.615916:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789066002.615922:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789066002.615938:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf073881000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789066002.615983:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433b9880 x1875971258021120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789066002.616012:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066002.616014:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789066002.616016:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789066002.616020:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 451 00000100:00080000:2.0:1789066002.616022:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789066002.616027:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf07b233800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789066002.616041:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433b9c00 x1875971258021248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789066002.616622:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789066002.616631:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258017792:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789066002.616705:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258021120:0@lo:8:kworker.0 00000400:00000100:1.0:1789066002.616770:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875971258021120 offset 0 length 520: 4 00000100:00100000:1.0:1789066002.616814:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258021248:0@lo:8:kworker.0 00000400:00000100:1.0:1789066002.616835:0:3294:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875971258021248 offset 0 length 520: 4 00010000:00010000:3.0:1789066003.302387:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789066003.941809:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789066003.941817:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07f2f7000 from 10 10000000:01000000:1.0:1789066003.941822:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789066003.941882:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066003.941895:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066003.941907:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066003.941934:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258021376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789066003.942005:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066003.942061:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050bc2540 going to sleep for 11 seconds 00000100:00100000:3.0:1789066003.942399:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258021376 00000100:00100000:3.0:1789066003.942415:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258021376 00000100:00100000:3.0:1789066003.942495:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789066003.942508:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+11:14409:x1875971258021376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789066003.942529:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066003.942583:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c836f8 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066003.942630:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c836f8 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066003.942660:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836f8 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066003.942679:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654600, rc 0) 00000100:00100000:3.0:1789066003.942762:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258021376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 258us (757us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066003.942769:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789066003.943014:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258021376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789066003.943039:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066003.943061:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066003.943169:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258021504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789066003.943209:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066003.943241:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0460dd240 going to sleep for 11 seconds 00000100:00100000:1.0:1789066003.944358:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258021504 00000100:00100000:1.0:1789066003.944392:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258021504 00000100:00100000:1.0:1789066003.944627:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789066003.944638:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258021504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789066003.945201:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258021504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 564us (1989us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066003.945220:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789066003.945913:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258021504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789066003.945971:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258021632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789066003.946023:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066003.946058:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0460dd240 going to sleep for 11 seconds 00000100:00100000:3.0:1789066003.946334:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258021632 00000100:00100000:3.0:1789066003.946350:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258021632 00000100:00100000:3.0:1789066003.946425:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789066003.946438:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258021632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789066003.946779:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:14409:x1875971258021632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 344us (754us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066003.946789:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789066003.947906:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258021632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789066003.950250:0:14900:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789066003.959952:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789066003.959987:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789066003.960002:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066003.960014:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066004.327776:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789066004.775134:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789066005.353243:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066006.374240:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066007.397900:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789066007.694808:0:15094:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789066007.694813:0:15094:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1789066007.694953:0:15094:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf050a10800 00000020:01000004:2.0:1789066007.694969:0:15094:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1789066007.694981:0:15094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789066007.694996:0:15094:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9cf07c033380) 00000020:00000080:2.0:1789066007.695014:0:15094:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00000100:00100000:0.0:1789066007.718164:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3296:1875971258021760:0@lo:400:kworker.0 00000100:00100000:0.0:1789066007.718242:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789066007.718313:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066007.718318:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789066007.718321:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066007.718323:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789066007.718370:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258021888:0@lo:400:kworker.0 00000100:00100000:2.0:1789066007.718417:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066007.718500:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258021888 00000100:00100000:2.0:1789066007.718508:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258021888 00000100:00100000:2.0:1789066007.718571:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789066007.718580:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258021888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789066007.718643:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258021888:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066007.718661:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789066007.718704:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cef433b8380 x1875971258021888/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066023 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789066007.718718:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258021888:0@lo:400:kworker.0 00000100:00100000:1.0:1789066007.719359:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258021760 00000100:00100000:1.0:1789066007.719364:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258021760 00000100:00100000:1.0:1789066007.719461:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789066007.719471:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:3296:x1875971258021760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066007.719530:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:3296:x1875971258021760:12345-0@lo:400:kworker.0 Request processed in 60us (1288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066007.719537:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789066007.719640:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3296:1875971258021760:0@lo:400:kworker.0 00100000:10000000:3.0:1789066007.722334:0:15094:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789066007.722622:0:15094:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789066007.723355:0:15094:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789066007.723637:0:15094:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789066007.723839:0:15094:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789066007.724192:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 327: rc = 0 00100000:10000000:3.0:1789066007.724287:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 327: rc = 0 00100000:10000000:3.0:1789066007.724377:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 327: rc = 0 00100000:10000000:3.0:1789066007.724994:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 592: rc = 0 00100000:10000000:3.0:1789066007.725257:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 592: rc = 0 00100000:10000000:3.0:1789066007.725519:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 592: rc = 0 00100000:10000000:3.0:1789066007.725803:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 592: rc = 0 00100000:10000000:3.0:1789066007.726050:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 592: rc = 0 00100000:10000000:3.0:1789066007.726303:0:15094:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 592: rc = 0 00000020:00000080:3.0:1789066007.726941:0:15094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789066007.726954:0:15094:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789066007.726965:0:15094:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7555615576c8370d 00000020:01000004:3.0:1789066007.726973:0:15094:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789066007.726993:0:15094:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789066007.726996:0:15094:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789066007.727002:0:15094:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789066007.727007:0:15094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789066007.727019:0:15094:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9cf074ea8000) 00000020:00000080:3.0:1789066007.727030:0:15094:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1789066007.729266:0:15094:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789066007.729478:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789066007.729484:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1789066007.730214:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1789066007.730225:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789066007.730965:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789066007.730980:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789066007.737461:0:15094:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789066007.738277:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789066007.738287:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789066007.741495:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789066007.741509:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1789066007.784205:0:15094:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789066007.786847:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789066007.786858:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1789066007.790766:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1789066007.790779:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1789066007.798956:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1789066007.798976:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1789066007.805709:0:15094:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789066007.805918:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1789066007.805925:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1789066007.806770:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1789066007.806779:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1789066007.850611:0:15094:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789066007.851117:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789066007.851128:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789066007.861230:0:15094:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1789066007.862188:0:15094:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1789066007.863184:0:15094:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1789066007.863213:0:15094:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1789066007.863221:0:15094:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1789066007.906760:0:15094:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:0.0:1789066007.906795:0:15094:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.123@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1789066007.906799:0:15094:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1789066007.906801:0:15094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789066007.906802:0:15094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789066007.906804:0:15094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789066007.906805:0:15094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789066007.906807:0:15094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789066007.906808:0:15094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789066007.906809:0:15094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789066007.906811:0:15094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789066007.906814:0:15094:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1789066007.906816:0:15094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789066007.906817:0:15094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789066007.906818:0:15094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789066007.906819:0:15094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789066007.906820:0:15094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789066007.906821:0:15094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789066007.906822:0:15094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789066007.906823:0:15094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789066007.906824:0:15094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1789066007.906847:0:15094:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789066007.906864:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022016:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789066007.906936:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.906986:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b2200c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789066007.907118:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022016 00000100:00100000:3.0:1789066007.907127:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022016 00000100:00100000:3.0:1789066007.907175:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789066007.907183:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:15094:x1875971258022016:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789066007.907210:0:14407:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789066007.907213:0:14407:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:3.0:1789066007.907217:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789066007.920210:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:15094:x1875971258022016:12345-0@lo:253:mount.lustre.0 Request processed in 13018us (13264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066007.920227:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789066007.920331:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022016:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789066007.920347:0:15094:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789066007.920374:0:15094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789066007.920376:0:15094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789066007.920378:0:15094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789066007.920379:0:15094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789066007.920380:0:15094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789066007.920381:0:15094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789066007.920383:0:15094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789066007.920384:0:15094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789066007.920386:0:15094:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789066007.920419:0:15094:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf050a10800 from lustre-OST0000 10000000:01000000:0.0:1789066007.920443:0:15094:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789066007.920446:0:15094:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789066007.920453:0:15094:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf074ea99c0 local copy 00010000:00010000:0.0:1789066007.920463:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066007.920853:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022144:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066007.920889:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.920966:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503180 going to sleep for 11 seconds 00000100:00100000:1.0:1789066007.921297:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022144 00000100:00100000:1.0:1789066007.921437:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022144 00000100:00100000:1.0:1789066007.921517:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789066007.921527:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:15094:x1875971258022144:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789066007.921732:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:15094:x1875971258022144:12345-0@lo:501:mount.lustre.0 Request processed in 206us (842us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789066007.921740:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789066007.921817:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022144:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789066007.921832:0:15094:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789066007.921966:0:15094:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789066007.921975:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.921986:0:15094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066007.922020:0:15094:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf050a10800 10000000:01000000:0.0:1789066007.922026:0:15094:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789066007.922030:0:15094:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9cf074ea99c0 10000000:01000000:0.0:1789066007.922039:0:15094:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789066007.922042:0:15094:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9cf074ea99c0 from 1 10000000:01000000:0.0:1789066007.922046:0:15094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789066007.922070:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.922079:0:15094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.922088:0:15094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066007.922101:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022272:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789066007.922128:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.922781:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503180 going to sleep for 11 seconds 00000100:00100000:2.0:1789066007.922842:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022272 00000100:00100000:2.0:1789066007.922848:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022272 00000100:00100000:1.0:1789066007.922997:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789066007.923006:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+12:15094:x1875971258022272:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789066007.923079:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789066007.923094:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a7c00/0x7555615576c83722 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8371b expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066007.923118:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a7c00/0x7555615576c83722 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8371b expref: 13 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066007.923128:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a7c00/0x7555615576c83722 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8371b expref: 13 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066007.923136:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7c00, rc 0) 00000100:00100000:1.0:1789066007.923274:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+13:15094:x1875971258022272:12345-0@lo:101:mount.lustre.0 Request processed in 269us (1144us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066007.923281:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789066007.923513:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789066007.923527:0:15094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83722 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.923536:0:15094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83722 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066007.923583:0:15094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1789066007.923651:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83722 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.923659:0:15094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b048e00/0x7555615576c8371b lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83722 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066007.923666:0:15094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789066007.923679:0:15094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789066007.923684:0:15094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1789066007.923686:0:15094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1789066007.923704:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.923712:0:15094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.923719:0:15094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066007.923733:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022400:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789066007.923764:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.923794:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f503180 going to sleep for 11 seconds 00000100:00100000:3.0:1789066007.923849:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022400 00000100:00100000:3.0:1789066007.923855:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022400 00000100:00100000:3.0:1789066007.923892:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789066007.923899:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+13:15094:x1875971258022400:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789066007.923908:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066007.923917:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081654c00/0x7555615576c83730 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83729 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066007.923932:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081654c00/0x7555615576c83730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83729 expref: 14 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066007.923941:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081654c00/0x7555615576c83730 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83729 expref: 14 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066007.923948:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654c00, rc 0) 00000100:00100000:3.0:1789066007.923978:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022400:12345-0@lo:101:mount.lustre.0 Request processed in 80us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066007.923984:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789066007.924153:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022400:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789066007.924163:0:15094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83730 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.924171:0:15094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83730 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789066007.925849:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789066007.926797:0:15094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789066007.927046:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789066007.927095:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789066007.927126:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789066007.927172:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789066007.927207:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789066007.927238:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1789066007.927323:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1789066007.927331:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1789066007.927419:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066007.927481:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.928203:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051e3fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789066007.928278:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022528 00000100:00100000:3.0:1789066007.928285:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022528 00000100:00100000:3.0:1789066007.928334:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789066007.928479:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022528:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789066007.928866:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022528:12345-0@lo:501:mount.lustre.0 Request processed in 522us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066007.928875:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789066007.929164:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022528:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066007.929210:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022656:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789066007.929251:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.929280:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051e3fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789066007.929535:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022656 00000100:00100000:3.0:1789066007.929542:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022656 00000100:00100000:2.0:1789066007.929755:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789066007.929765:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022656:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789066007.931161:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022656:12345-0@lo:503:mount.lustre.0 Request processed in 1392us (1903us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066007.931173:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789066007.931478:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022656:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789066007.933142:0:15094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789066007.933247:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066007.933533:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066007.933697:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022784 00000100:00100000:1.0:1789066007.933705:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022784 00000100:00100000:1.0:1789066007.933796:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789066007.933806:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022784:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066007.934088:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051e3fc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789066007.934164:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022784:12345-0@lo:502:mount.lustre.0 Request processed in 359us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066007.934172:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1789066007.934253:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789066007.934568:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1789066007.934631:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1789066007.934666:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1789066007.934715:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1789066007.934746:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1789066007.934775:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1789066007.934815:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1789066007.934847:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1789066007.934876:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1789066007.934914:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1789066007.934944:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1789066007.934992:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1789066007.935187:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022912:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066007.935231:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.935602:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051e3fc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789066007.935745:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258022912 00000100:00100000:3.0:1789066007.935752:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258022912 00000100:00100000:3.0:1789066007.935788:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789066007.935796:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022912:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789066007.935957:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258022912:12345-0@lo:502:mount.lustre.0 Request processed in 161us (725us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066007.935965:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789066007.936099:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258022912:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789066007.936177:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1789066007.936187:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:3.0:1789066007.937732:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789066007.937743:0:15108:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789066007.937749:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066007.937752:0:15108:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789066007.937757:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789066007.937772:0:15108:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9cf074eab380) 00000020:00000080:3.0:1789066007.937796:0:15108:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789066007.937801:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789066007.937872:0:15108:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf050a10800 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789066007.937880:0:15108:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789066007.937886:0:15108:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x7555615576c8373e 00010000:00010000:3.0:1789066007.942720:0:15108:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1789066007.943243:0:15108:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967325 00080000:10000000:0.0:1789066007.947966:0:15108:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789066007.950257:0:15108:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1789066007.950269:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789066007.950275:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789066007.950277:0:15108:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1789066007.950281:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1789066007.950284:0:15108:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:0.0:1789066007.950286:0:15108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789066007.950287:0:15108:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1789066007.950289:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1789066007.950291:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789066007.950292:0:15108:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:0.0:1789066007.950295:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789066007.950298:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789066007.950299:0:15108:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789066007.950302:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789066007.950304:0:15108:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1789066007.950317:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789066007.950320:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789066007.950322:0:15108:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:0.0:1789066007.950325:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789066007.950327:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789066007.950329:0:15108:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789066007.950332:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1789066007.950776:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789066007.950780:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789066007.950791:0:15108:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789066007.950794:0:15108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1789066007.967469:0:15094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1789066007.967516:0:15094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789066007.967615:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83730 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066007.967630:0:15094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b049400/0x7555615576c83729 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83730 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789066007.967639:0:15094:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf050a10800 from 1 10000000:01000000:2.0:1789066007.967642:0:15094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789066007.967682:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066007.967690:0:15094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066007.967701:0:15094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066007.967725:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023040:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789066007.967787:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066007.967827:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789066007.970133:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023040 00000100:00100000:0.0:1789066007.970145:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023040 00000100:00100000:0.0:1789066007.970195:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789066007.970205:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+14:15094:x1875971258023040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789066007.970221:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066007.970240:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83745 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.970268:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83745 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.970280:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83745 expref: 15 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066007.970288:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049000, rc 0) 00000100:00100000:0.0:1789066007.970353:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023040:12345-0@lo:101:mount.lustre.0 Request processed in 149us (2565us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066007.970360:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789066007.972908:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023040:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789066007.972939:0:15094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066007.972975:0:15094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789066007.985135:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1789066007.985801:0:15094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789066007.986067:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1789066007.986109:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1789066007.986163:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1789066007.986170:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1789066007.986248:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066007.986316:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066007.986373:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789066007.986915:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023168 00000100:00100000:1.0:1789066007.986922:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023168 00000100:00100000:1.0:1789066007.986972:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789066007.986981:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023168:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789066007.987203:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023168:12345-0@lo:501:mount.lustre.0 Request processed in 222us (886us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066007.987216:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789066007.987989:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023168:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066007.988080:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023296:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789066007.988128:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066007.988196:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789066007.989944:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023296 00000100:00100000:1.0:1789066007.989957:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023296 00000100:00100000:1.0:1789066007.990090:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789066007.990101:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023296:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789066007.990698:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023296:12345-0@lo:503:mount.lustre.0 Request processed in 597us (2567us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066007.990707:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789066007.991530:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023296:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789066007.993508:0:15094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789066007.993791:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789066007.994066:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066007.994155:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fcc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789066007.994208:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023424 00000100:00100000:0.0:1789066007.994216:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023424 00000100:00100000:0.0:1789066007.994295:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789066007.994304:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066007.994533:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023424:12345-0@lo:502:mount.lustre.0 Request processed in 229us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066007.994541:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789066007.994742:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023424:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789066007.995039:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789066007.995092:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789066007.995140:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789066007.995175:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789066007.995207:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789066007.995250:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789066007.995285:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789066007.995317:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789066007.995347:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023552:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066007.995419:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066007.995997:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023552 00000100:00100000:0.0:1789066007.996004:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023552 00000100:00100000:0.0:1789066007.996039:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789066007.996046:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023552:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066007.996196:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023552:12345-0@lo:502:mount.lustre.0 Request processed in 149us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066007.996204:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789066007.996428:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05093d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789066007.996449:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bb480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023552:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789066007.996736:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789066007.996752:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1789066007.997915:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789066007.997925:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066007.997928:0:15112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789066007.997934:0:15112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf050a10800 00000020:00000080:1.0:1789066007.997937:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789066007.997943:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789066007.997945:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066007.997946:0:15112:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789066007.997949:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789066007.997951:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066007.997952:0:15112:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789066007.997955:0:15112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf050a10800 00000020:00000080:1.0:1789066007.997957:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789066008.002339:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789066008.002353:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066008.002355:0:15112:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789066008.002358:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789066008.002381:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066008.002382:0:15112:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789066008.002388:0:15112:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf050a10800 00000020:00000080:1.0:1789066008.002390:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789066008.002522:0:15112:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789066008.002527:0:15112:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066008.002528:0:15112:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1789066008.002531:0:15112:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1789066008.010889:0:15094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789066008.010933:0:15094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789066008.010953:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066008.010966:0:15094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789066008.011026:0:15094:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789066008.011029:0:15094:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf050a10800 10000000:01000000:3.0:1789066008.011033:0:15094:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf050a10800 10000000:01000000:3.0:1789066008.011036:0:15094:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789066008.011042:0:15094:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf050a10800 from 1 10000000:01000000:3.0:1789066008.011045:0:15094:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789066008.011084:0:15094:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066008.011093:0:15094:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066008.011105:0:15094:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066008.011128:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023680:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789066008.011190:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066008.011232:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437ce3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789066008.013954:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023680 00000100:00100000:0.0:1789066008.013968:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023680 00000100:00100000:0.0:1789066008.014102:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789066008.014113:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258023680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789066008.014131:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066008.014150:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07b048200/0x7555615576c8375a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83753 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.014182:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b048200/0x7555615576c8375a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83753 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.014195:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07b048200/0x7555615576c8375a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83753 expref: 16 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.014204:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b048200, rc 0) 00000100:00100000:0.0:1789066008.014298:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258023680:12345-0@lo:101:mount.lustre.0 Request processed in 187us (3108us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066008.014316:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789066008.014888:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023680:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789066008.014910:0:15094:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8375a expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066008.014920:0:15094:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8375a expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789066008.017145:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:3.0:1789066008.017671:0:15094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789066008.017945:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789066008.018002:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789066008.018035:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789066008.018081:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789066008.018117:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789066008.018167:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789066008.018204:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789066008.018239:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789066008.018288:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789066008.018331:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789066008.018362:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789066008.018420:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789066008.018455:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789066008.018490:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789066008.018537:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789066008.018611:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789066008.018720:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789066008.018769:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789066008.018803:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789066008.018835:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789066008.018880:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789066008.018915:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789066008.018946:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789066008.018990:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789066008.019026:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789066008.019058:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789066008.019103:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789066008.019141:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789066008.019221:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789066008.019229:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789066008.019338:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789066008.019419:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066008.019475:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023808 00000100:00100000:3.0:1789066008.019490:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023808 00000100:00100000:3.0:1789066008.022740:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789066008.022757:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258023808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066008.023361:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0437ce3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789066008.024166:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258023808:12345-0@lo:501:mount.lustre.0 Request processed in 1412us (4743us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066008.024179:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789066008.024354:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023808:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066008.024439:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023936:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789066008.024489:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066008.024522:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789066008.024714:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258023936 00000100:00100000:0.0:1789066008.024721:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258023936 00000100:00100000:0.0:1789066008.024763:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789066008.024772:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258023936:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789066008.024960:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258023936:12345-0@lo:503:mount.lustre.0 Request processed in 188us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066008.024967:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1789066008.025100:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258023936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789066008.025691:0:15094:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789066008.025770:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258024064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066008.025819:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066008.025845:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf05f059c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789066008.029102:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024064 00000100:00100000:3.0:1789066008.029116:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024064 00000100:00100000:3.0:1789066008.029171:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789066008.029181:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258024064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789066008.030279:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258024064:12345-0@lo:502:mount.lustre.0 Request processed in 1097us (4457us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066008.030289:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789066008.030728:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258024064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789066008.031094:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789066008.031147:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789066008.031176:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789066008.031233:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789066008.031454:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789066008.031507:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789066008.031702:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789066008.031738:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789066008.031788:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789066008.031826:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789066008.031860:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789066008.031905:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789066008.031939:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789066008.031969:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789066008.032105:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789066008.032143:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789066008.032176:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789066008.032221:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789066008.032253:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789066008.032501:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789066008.032869:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789066008.032910:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789066008.032947:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789066008.032996:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789066008.033105:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789066008.033139:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789066008.033197:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789066008.033232:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789066008.033467:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789066008.033682:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789066008.033724:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789066008.033761:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789066008.033796:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789066008.033845:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789066008.033880:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789066008.033947:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789066008.033982:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789066008.034095:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789066008.034147:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789066008.034183:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789066008.034233:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258024192:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066008.034504:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066008.034685:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024192 00000100:00100000:0.0:1789066008.034687:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a8d6180 going to sleep for 11 seconds 00000100:00100000:3.0:1789066008.034693:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024192 00000100:00100000:3.0:1789066008.034748:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789066008.034758:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258024192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789066008.035123:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258024192:12345-0@lo:502:mount.lustre.0 Request processed in 366us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066008.035131:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789066008.035463:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258024192:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789066008.035696:0:15094:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1789066008.035708:0:15094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1789066008.038709:0:15117:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1789066008.038726:0:15117:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9cf0581e4d40) 00000020:00000080:3.0:1789066008.038745:0:15117:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:3.0:1789066008.038832:0:15117:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf050a10800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789066008.038836:0:15117:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf050a10800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1789066008.038838:0:15117:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf050a10800 3 00010000:00080000:3.0:1789066008.038948:0:15117:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cf081897800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.123@tcp at head 00010000:00010000:3.0:1789066008.041960:0:15117:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1789066008.042602:0:15117:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1789066008.042642:0:15117:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789066008.042655:0:15117:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x7555615576c83768 00000100:00080000:3.0:1789066008.042666:0:15117:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789066008.042802:0:15117:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9cf081897800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789066008.042840:0:15117:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70f480 x1875971258024320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789066008.042879:0:15117:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789066008.042928:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3294:1875971258024320:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789066008.042996:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789066008.043044:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789066008.043050:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789066008.043053:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789066008.043056:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789066008.043101:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258024448:0@lo:400:kworker.0 00000100:00100000:0.0:1789066008.043129:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066008.043214:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024320 00000100:00100000:3.0:1789066008.043216:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024448 00000100:00100000:3.0:1789066008.043222:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024448 00000100:00100000:1.0:1789066008.043222:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024320 00000100:00100000:1.0:1789066008.043251:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789066008.043270:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258024448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066008.043331:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258024448:12345-0@lo:400:kworker.0 Request processed in 63us (201us total) trans 0 rc 0/0 00010000:00080000:0.0:1789066008.043391:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf07b0b1500 x1875971258024448/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066008.043429:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258024448:0@lo:400:kworker.0 00000100:00100000:3.0:1789066008.044302:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789066008.044851:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3294:x1875971258024320:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789066008.045297:0:14414:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 467 last 0 00000020:00000080:3.0:1789066008.045473:0:14414:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x7555615576c8376f 00000004:00100000:3.0:1789066008.045490:0:14414:0:(mdt_handler.c:7356:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789066008.045520:0:14414:0:(import.c:65:import_set_state_nolock()) ffff9cf0478aa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789066008.045977:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3294:x1875971258024320:12345-0@lo:38:llog_process_th.0 Request processed in 1126us (2979us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066008.045987:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789066008.046762:0:15117:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00010000:00080000:0.0:1789066008.047146:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9cf07f70f480 x1875971258024320/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789066018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066008.047160:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789066008.047170:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1789066008.047178:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789066008.047185:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789066008.047188:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf081897800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789066008.047195:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3294:1875971258024320:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789066008.047224:0:15094:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789066008.047251:0:15094:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789066008.047273:0:15094:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8375a expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.047284:0:15094:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf081654200/0x7555615576c83753 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8375a expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789066008.047328:0:15094:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789066008.047331:0:15094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789066008.047332:0:15094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789066008.047333:0:15094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789066008.047335:0:15094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789066008.047336:0:15094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789066008.047338:0:15094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789066008.047340:0:15094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789066008.047342:0:15094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789066008.047345:0:15094:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789066008.047347:0:15094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789066008.047354:0:15094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789066008.047355:0:15094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789066008.047356:0:15094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789066008.047356:0:15094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789066008.047357:0:15094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789066008.047358:0:15094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789066008.047359:0:15094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789066008.047360:0:15094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789066008.047391:0:15094:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789066008.047418:0:15094:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258024576:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789066008.047469:0:15094:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066008.047508:0:15094:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0535f7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789066008.047703:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024576 00000100:00100000:3.0:1789066008.047711:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024576 00000100:00100000:3.0:1789066008.047802:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789066008.047812:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15094:x1875971258024576:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789066008.047834:0:14407:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789066008.047847:0:14407:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789066008.048905:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 20000000:01000000:3.0:1789066008.115385:0:14407:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789066008.115418:0:14407:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789066008.115460:0:14428:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789066008.115466:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789066008.115489:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.115518:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836dc expref: 16 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.115528:0:14428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.115601:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c836dc expref: 16 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066008.115618:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c836dc expref: 16 pid: 14407 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066008.115632:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14428:1875971258024704:0@lo:104: 00000100:00100000:0.0:1789066008.115702:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066008.115752:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b2200c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789066008.115933:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024704 00000100:00100000:1.0:1789066008.115943:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024704 00000100:00100000:1.0:1789066008.116006:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789066008.116017:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14428:x1875971258024704:12345-0@lo:104: 00010000:00010000:1.0:1789066008.116030:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066008.116094:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789066008.116100:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14428:x1875971258024704:12345-0@lo:104: Request processed in 86us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066008.116108:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789066008.116236:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066008.116245:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.116253:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6c00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:2.0:1789066008.116257:0:14400:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.116267:0:14400:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789066008.116275:0:14400:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789066008.116281:0:14400:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789066008.116319:0:14400:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.116352:0:14400:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789066008.116386:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.116394:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c836dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836e3 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.116422:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066008.116424:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066008.116425:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789066008.116447:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258024832:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789066008.116477:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066008.116985:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024832 00000100:00100000:2.0:1789066008.116992:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024832 00000100:00100000:3.0:1789066008.117115:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b0000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14428:1875971258024704:0@lo:104: 00010000:00010000:3.0:1789066008.117141:0:14428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117215:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c836dc expref: 17 pid: 14407 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066008.117250:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789066008.117257:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:3295:x1875971258024832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789066008.117267:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066008.117272:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c836dc expref: 17 pid: 14407 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117281:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c836dc expref: 17 pid: 14407 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117295:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf0817a7a00/0x7555615576c836e3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c836dc expref: 17 pid: 14407 timeout: 567 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117323:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117332:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789066008.117912:0:14399:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002446637s 00010000:00010000:2.0:1789066008.117918:0:14399:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117925:0:14399:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117933:0:14399:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117939:0:14399:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117944:0:14399:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066008.117948:0:14399:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.117955:0:14399:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066008.124983:0:14428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066008.125012:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.125188:0:14399:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.125201:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07b049600/0x7555615576c83776 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066008.125252:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789066008.125506:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433ba300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3295:x1875971258024832:12345-0@lo:103:ldlm_bl.0 Request processed in 8245us (9023us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066008.125609:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789066008.127691:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258024832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066008.156771:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:15094:x1875971258024576:12345-0@lo:253:mount.lustre.0 Request processed in 108949us (109290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066008.156788:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789066008.157147:0:15094:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15094:1875971258024576:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789066008.157165:0:15094:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789066008.157169:0:15094:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789066008.157171:0:15094:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789066008.157173:0:15094:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789066008.157174:0:15094:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789066008.157176:0:15094:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789066008.157177:0:15094:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789066008.157179:0:15094:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789066008.157181:0:15094:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789066008.157182:0:15094:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789066008.157212:0:15094:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789066008.166458:0:15094:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789066008.166970:0:15094:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789066008.167137:0:15094:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789066008.167899:0:15094:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789066008.172669:0:15094:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789066008.175025:0:15094:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789066008.178178:0:15094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789066008.290121:0:15094:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789066008.290130:0:15094:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789066008.290161:0:15094:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789066008.290296:0:15094:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789066008.290313:0:15094:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789066008.290342:0:15094:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1789066008.422484:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789066009.190389:0:14409:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789066009.190397:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf07f2f7000 from 7 10000000:01000000:2.0:1789066009.190403:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789066009.190453:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066009.190465:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066009.190497:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066009.190526:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258024960:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789066009.190634:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066009.190688:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789066009.191026:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258024960 00000100:00100000:3.0:1789066009.191038:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258024960 00000100:00100000:3.0:1789066009.191103:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789066009.191113:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+15:14409:x1875971258024960:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789066009.191129:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066009.191148:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8377d expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066009.191176:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8377d expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066009.191187:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8377d expref: 16 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066009.191196:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654000, rc 0) 00000100:00100000:3.0:1789066009.191247:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:14409:x1875971258024960:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066009.191266:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789066009.191500:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258024960:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789066009.191517:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066009.191526:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066009.191615:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258025088:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789066009.191646:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066009.191668:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20ad80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066009.191735:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025088 00000100:00100000:1.0:1789066009.191745:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025088 00000100:00100000:1.0:1789066009.191772:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789066009.191779:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:14409:x1875971258025088:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789066009.191804:0:14405:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789066009.191821:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789066009.191824:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1789066009.191911:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:14409:x1875971258025088:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066009.191918:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789066009.191949:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258025088:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789066009.192261:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789066009.192269:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066009.192278:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066009.449280:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066010.475329:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066011.498670:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066012.518701:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789066013.355395:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789066013.355402:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789066013.355405:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789066013.355408:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789066013.355428:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3296:1875971258025216:0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.355509:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066013.355608:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025216 00000100:00100000:3.0:1789066013.355615:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025216 00000100:00100000:3.0:1789066013.355663:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789066013.355671:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3296:x1875971258025216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.355724:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3296:x1875971258025216:12345-0@lo:400:kworker.0 Request processed in 52us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066013.355730:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789066013.355774:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3296:1875971258025216:0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.355816:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258025344:0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.355842:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066013.355877:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025344 00000100:00100000:3.0:1789066013.355881:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025344 00000100:00100000:3.0:1789066013.355908:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789066013.355925:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258025344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.355959:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258025344:12345-0@lo:400:kworker.0 Request processed in 36us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066013.355965:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789066013.355994:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07f70d500 x1875971258025344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789066013.356005:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258025344:0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.356036:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258025472:0@lo:400:kworker.0 00000100:00100000:3.0:1789066013.356063:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066013.356091:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025472 00000100:00100000:3.0:1789066013.356095:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025472 00000100:00100000:3.0:1789066013.356123:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789066013.356129:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258025472:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789066013.356366:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789066013.356783:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258025472:12345-0@lo:400:kworker.0 Request processed in 651us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066013.356791:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789066013.370046:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07f70d500 x1875971258025472/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066013.370065:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258025472:0@lo:400:kworker.0 00010000:00010000:3.0:1789066013.544147:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066014.565913:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789066015.016347:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1789066015.592995:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789066015.705424:0:15461:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789066016.629901:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789066017.262682:0:3294:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789066002/real 1789066002] req@ffff9cef433b9880 x1875971258021120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066017 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066017.262715:0:3294:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cef433b9880 x1875971258021120/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066017 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066017.262726:0:3294:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789066002/real 1789066002] req@ffff9cef433b9c00 x1875971258021248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066017 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066017.262737:0:3294:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9cef433b9c00 x1875971258021248/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789066017 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789066017.262756:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf073881000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789066017.262779:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789066017.262783:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258021120:0@lo:8:kworker.0 00000100:00080000:0.0:1789066017.262789:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789066017.262795:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789066017.262797:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258021248:0@lo:8:kworker.0 00000100:00080000:3.0:1789066017.263086:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789066017.263092:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789066017.263095:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf073881000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789066017.263102:0:8:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00100000:0.0:1789066017.263102:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258025600:0@lo:400:kworker.0 00000100:00080000:3.0:1789066017.263108:0:8:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789066017.263121:0:8:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9cf073881000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789066017.263154:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70d880 x1875971258025728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789066017.263172:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789066017.263176:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789066017.263179:0:8:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789066017.263181:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789066017.263190:0:8:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 461 00000100:00080000:3.0:1789066017.263195:0:8:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789066017.263201:0:8:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf07b233800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789066017.263216:0:8:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70c000 x1875971258025856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789066017.263248:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789066017.263257:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258025984:0@lo:400:kworker.0 00000100:00100000:0.0:1789066017.263287:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066017.263305:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258026112:0@lo:400:kworker.0 00000100:00100000:0.0:1789066017.263323:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025600 00000100:00100000:3.0:1789066017.263343:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066017.263343:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025600 00000100:00100000:0.0:1789066017.263393:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789066017.263403:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025984 00000100:00100000:0.0:1789066017.263404:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3295:x1875971258025600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066017.263410:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025984 00000100:00100000:3.0:1789066017.263459:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026112 00000100:00100000:3.0:1789066017.263464:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026112 00000100:00100000:0.0:1789066017.263466:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3295:x1875971258025600:12345-0@lo:400:kworker.0 Request processed in 61us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066017.263475:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789066017.263496:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789066017.263505:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258025984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066017.263516:0:14413:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789066017.263527:0:14413:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789066017.263543:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258025984:12345-0@lo:400:kworker.0 Request processed in 40us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066017.263584:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789066017.263598:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789066017.263605:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258026112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066017.263636:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258026112:12345-0@lo:400:kworker.0 Request processed in 32us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066017.263643:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1789066017.263674:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789066017.263698:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258025728:0@lo:8:kworker.0 00010000:00080000:3.0:1789066017.263715:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07f70ea00 x1875971258026112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789066017.263731:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258026112:0@lo:400:kworker.0 00000100:00100000:0.0:1789066017.263733:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066017.263764:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025728 00000100:00100000:3.0:1789066017.263768:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025728 00000100:00100000:0.0:1789066017.263771:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258025856:0@lo:8:kworker.0 00000100:00100000:3.0:1789066017.263790:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789066017.263796:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3294:x1875971258025728:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789066017.263803:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789066017.263824:0:15095:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 476 last 0 00010000:00080000:0.0:1789066017.263846:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07f70f800 x1875971258025984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066033 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000020:00000080:3.0:1789066017.263852:0:15095:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c8378b 00000100:00100000:0.0:1789066017.263858:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258025984:0@lo:400:kworker.0 00002000:00100000:3.0:1789066017.263867:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9cf0478ac000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:0.0:1789066017.263870:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258025600:0@lo:400:kworker.0 00002000:00080000:3.0:1789066017.263874:0:15095:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789066017.263879:0:15095:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1789066017.264146:0:15096:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1789066017.264155:0:15096:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00002000:00080000:3.0:1789066017.264258:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789066017.264281:0:15095:0:(import.c:65:import_set_state_nolock()) ffff9cf0478a8000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789066017.264337:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3294:x1875971258025728:12345-0@lo:8:kworker.0 Request processed in 540us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066017.264345:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789066017.264355:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258025856 00000100:00100000:3.0:1789066017.264359:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258025856 00000100:00100000:3.0:1789066017.264372:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789066017.264377:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3294:x1875971258025856:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789066017.264388:0:15095:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:2.0:1789066017.264421:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07f70d880 x1875971258025728/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789066037 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789066017.264431:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789066017.264438:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1789066017.264445:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1789066017.264450:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1789066017.264458:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf073881000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1789066017.264475:0:3294:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1789066017.264481:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258025728:0@lo:8:kworker.0 00000004:00080000:2.0:1789066017.264527:0:14436:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:2.0:1789066017.264543:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1875971258026368:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789066017.264593:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3294:x1875971258025856:12345-0@lo:8:kworker.0 Request processed in 213us (793us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789066017.264602:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066017.264606:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789066017.264617:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7540 going to sleep for 11 seconds 00000100:00100000:3.0:1789066017.264627:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026368 00000100:00100000:3.0:1789066017.264632:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026368 00000100:00100000:2.0:1789066017.264636:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258026240:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789066017.264663:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789066017.264669:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066017.264674:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1875971258026368:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:2.0:1789066017.264714:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789066017.264720:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789066017.264724:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258025856:0@lo:8:kworker.0 00000100:00100000:1.0:1789066017.265353:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026240 00000100:00100000:1.0:1789066017.265360:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026240 00000100:00100000:1.0:1789066017.265392:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789066017.265401:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875971258026240:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789066017.265427:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000004:00080000:0.0:1789066017.265500:0:14435:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789066017.265768:0:14435:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 476459218945ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789066017.269257:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3298:x1875971258026240:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3850us (4581us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066017.269272:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789066017.269436:0:3298:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cef433b8e00 x1875971258026240/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789066033 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789066017.269462:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258026240:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1789066017.270483:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1789066017.281891:0:15095:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1789066017.281904:0:15095:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1789066017.281911:0:15095:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1789066017.299709:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.299722:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299741:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.299747:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.299753:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299773:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299786:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299795:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299815:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789066017.299829:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789066017.299836:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299921:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066017.299927:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299938:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299957:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299966:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c83792 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.299989:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.299993:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.299996:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.300952:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.300963:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.300975:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.300978:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.300984:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.300995:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301012:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301020:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301036:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789066017.301048:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789066017.301053:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301060:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066017.301063:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301072:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301085:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301093:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83799 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.301107:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.301115:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.301117:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.304679:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.304693:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304711:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.304715:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.304723:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304737:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304748:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304756:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304775:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789066017.304788:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789066017.304794:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304802:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066017.304807:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304827:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304845:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304853:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.304871:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.304872:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.304874:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.310723:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.310740:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310761:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.310766:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.310774:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310791:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310804:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310822:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310842:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789066017.310856:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789066017.310864:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310873:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066017.310879:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310889:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310909:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310917:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c837a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.310936:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.310937:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.310939:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.311568:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.311583:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.311593:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.311597:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.311602:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.311612:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.311621:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.311628:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.311647:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066017.312427:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:3.0:1789066017.312437:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066017.312438:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312445:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312473:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=476s v=(0 0) 00010000:00010000:0.0:1789066017.312473:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066017.312480:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066017.312481:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312485:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312500:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312505:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312523:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312525:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312569:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312572:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c837ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.312593:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066017.312601:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066017.312606:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312615:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066017.312618:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312626:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312639:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312656:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.312675:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.312678:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.312682:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.312751:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.314111:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.314123:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.314366:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.314370:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.314376:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.314388:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.314397:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.314405:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.314969:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066017.316529:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.316542:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.316585:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.316591:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.316603:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.316627:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.316635:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c837bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.316659:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.316662:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.316664:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789066017.318649:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:3.0:1789066017.318794:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.318805:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.318822:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.318826:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.318832:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.318856:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.318867:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.318875:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.318896:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789066017.319714:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.319723:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.319734:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.319742:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.319747:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.319757:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.319767:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.319775:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.319787:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1789066017.320923:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.320933:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.320945:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.320948:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.320953:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.320963:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.320972:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.320986:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.321055:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1789066017.321743:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.321750:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.321759:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.321762:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.321766:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.321774:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.321783:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.321790:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.321798:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:1.0:1789066017.323459:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789066017.323473:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323501:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.323507:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323518:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323542:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323566:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c837c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323592:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789066017.323596:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323602:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.323605:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323613:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323623:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323636:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c837ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323649:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789066017.323652:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323658:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.323661:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323669:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323679:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323686:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c837d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323696:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.323700:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323706:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.323714:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323722:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323733:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323739:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c837d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.323751:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.323752:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.323754:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.323787:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.325734:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.325747:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.325772:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.325778:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.325785:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.325800:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.325811:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.325820:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.325855:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066017.326284:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.326292:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.326302:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.326307:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.326317:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.326343:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.326357:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000afa73ec5/0x7555615576c837df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.326376:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.326378:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.326380:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.334888:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.334904:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.334922:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.334926:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.334933:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.334948:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.334977:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.334986:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.335019:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789066017.335281:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066017.335290:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.335300:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066017.335304:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.335314:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.335411:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.335420:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024854eaf/0x7555615576c837e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.335447:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.335449:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.335451:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.336044:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.336051:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.336060:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.336064:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.336068:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.336079:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.336087:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.336095:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.336195:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789066017.336819:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.336826:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.336835:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.336838:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066017.337371:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066017.337380:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337390:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066017.337395:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337404:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337421:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337429:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004000f815/0x7555615576c837ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337464:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.337466:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.337467:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.337602:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.337619:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.337630:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.337638:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.337656:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789066017.337739:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066017.337745:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337754:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066017.337758:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337780:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337793:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337802:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000080bc4a0d/0x7555615576c837f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.337820:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.337824:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.337826:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.340651:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.340667:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.340684:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.340696:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.340702:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.340716:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.340727:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.340735:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.340756:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789066017.341448:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066017.341459:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.341483:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066017.341488:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.341498:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.341521:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.341529:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e15eed0b/0x7555615576c837fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.341570:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.341573:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.341574:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.342713:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.342724:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.342740:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.342744:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.342752:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.342766:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.342776:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.342790:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.342819:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066017.342843:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066017.342852:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.342861:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066017.342865:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.342875:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.342894:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.342903:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc33b926/0x7555615576c83802 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.342920:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.342922:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.342924:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.343731:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.343742:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.343753:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.343758:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.343764:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.343776:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.343787:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.343795:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.343823:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066017.344592:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.344605:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.344618:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.344624:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.344634:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.344654:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.344663:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009452e143/0x7555615576c83809 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.344685:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.344687:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.344688:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.346070:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.346082:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.346103:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.346108:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.346114:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.347945:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.347977:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.347985:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.348095:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066017.348715:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.348724:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.348735:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.348740:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.348750:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.348770:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.348778:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000069cccfa2/0x7555615576c83810 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.348810:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.348812:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.348813:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.350578:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.350590:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.350605:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.350610:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.350616:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.350630:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.350654:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.350664:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.350729:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789066017.351231:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.351238:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.351249:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.351253:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.351257:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.351268:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.351287:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.351296:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.355962:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789066017.355978:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.355993:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.356007:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.356044:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.356067:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.356075:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000059625ee9/0x7555615576c83817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.356103:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.356106:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.356113:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.356116:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.356124:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.357878:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.357893:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.357895:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.357906:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.361051:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789066017.361066:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000097b4dd8e/0x7555615576c8381e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789066017.361814:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.361823:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.361838:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.363178:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.363199:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.363231:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.363244:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.363252:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.364869:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.364883:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.364896:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.364902:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.364913:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.364933:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.365156:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.365160:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.365162:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.367090:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789066017.367383:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789066017.367398:0:15095:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83825 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789066017.368918:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.368930:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.368946:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.368950:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.368957:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.368971:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.368982:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.368991:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.369028:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066017.369428:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066017.369438:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.369449:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066017.369453:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.369464:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.369483:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.369490:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000727c7e84/0x7555615576c8382c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.369513:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.369515:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.369517:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.371686:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.371699:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.371715:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.371719:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.371730:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.371745:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.371756:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.371764:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.371783:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789066017.372680:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.372689:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.372700:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.372704:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.372708:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.372719:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.372728:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.372747:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.372765:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789066017.372959:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789066017.372967:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.372976:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.372981:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.372990:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373018:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373034:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83833 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373055:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066017.373059:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373067:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066017.373071:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373080:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373091:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373099:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c8383a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066017.373109:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.373111:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066017.373112:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.374363:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.377769:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.377785:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.377802:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.377807:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.377813:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.377826:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.377836:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.377855:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.377880:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789066017.379188:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789066017.379200:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.379212:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066017.379217:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.379237:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.379269:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.379285:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83841 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066017.379310:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.379312:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066017.379314:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789066017.379500:0:15095:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789066017.379507:0:15095:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.379524:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=476s v=(0 0) 00010000:00010000:3.0:1789066017.379529:0:15095:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066017.379534:0:15095:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.379576:0:15095:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.379588:0:15095:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.379597:0:15095:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066017.379617:0:15095:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1789066017.379832:0:15095:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00000100:00100000:2.0:1789066017.380445:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14436:x1875971258026368:12345-0@lo:5:osp-pre-0-0.0 Request processed in 115769us (115840us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066017.380458:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789066017.380470:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066017.380478:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.380503:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066017.380507:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.380515:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.380531:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.380537:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000beeeeb1b/0x7555615576c83848 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15095 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066017.380570:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.380572:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066017.380574:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066017.380803:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bbb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1875971258026368:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789066017.380820:0:14436:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:3.0:1789066017.380955:0:14436:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1875971258026496:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789066017.381064:0:14436:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066017.381142:0:14436:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0510cdb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789066017.381191:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026496 00000100:00100000:2.0:1789066017.381199:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026496 00000100:00100000:2.0:1789066017.381262:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789066017.381272:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14436:x1875971258026496:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789066017.381388:0:15096:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:0.0:1789066017.392106:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14436:x1875971258026496:12345-0@lo:5:osp-pre-0-0.0 Request processed in 10824us (11098us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1789066017.392124:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789066017.392419:0:14436:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14436:1875971258026496:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1789066017.392525:0:14436:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789066017.638032:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789066018.588573:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:3.0:1789066018.588631:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789066018.661727:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066019.685731:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066020.711737:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066021.734543:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789066022.566681:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789066022.566689:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1789066022.566693:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789066022.566701:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 476 00000100:00080000:0.0:1789066022.566708:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789066022.566720:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf07b233800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:0.0:1789066022.566755:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07b0b1c00 x1875971258026880/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789066022.566813:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258026624:0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.566879:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066022.566935:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789066022.566942:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258026752:0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.566970:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066022.567001:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258026880:0@lo:8:kworker.0 00000100:00100000:0.0:1789066022.567037:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066022.567065:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258027008:0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.567090:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066022.567110:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789066022.567115:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258027136:0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.567146:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066022.567364:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026752 00000100:00100000:2.0:1789066022.567372:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026752 00000100:00100000:1.0:1789066022.567722:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789066022.567734:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258027264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789066022.567768:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066022.567799:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027264 00000100:00100000:1.0:1789066022.567804:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027264 00000100:00100000:1.0:1789066022.567836:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789066022.567845:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971258027264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789066022.567911:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789066022.567952:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3296:x1875971258027264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066022.567958:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789066022.567976:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026880 00000100:00100000:2.0:1789066022.567980:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026880 00000100:00100000:2.0:1789066022.567997:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789066022.568003:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258026752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789066022.568349:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258026752:12345-0@lo:400:kworker.0 Request processed in 345us (1377us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066022.568356:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789066022.568379:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789066022.568382:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789066022.568386:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3294:x1875971258026880:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1789066022.568400:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258027264:0@lo:13:osp-pre-0-0.0 00010000:00020000:2.0:1789066022.568402:0:15095:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789066022.568421:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258026752:0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.568561:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258026624 00000100:00100000:0.0:1789066022.568566:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258026624 00000100:00100000:0.0:1789066022.568601:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789066022.568609:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3295:x1875971258026624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.568649:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:3295:x1875971258026624:12345-0@lo:400:kworker.0 Request processed in 40us (1770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066022.568655:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789066022.568688:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027008 00000100:00100000:0.0:1789066022.568692:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027008 00000100:00100000:0.0:1789066022.568715:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027136 00000100:00100000:0.0:1789066022.568718:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027136 00000100:00100000:0.0:1789066022.568739:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789066022.568746:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258027008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.568794:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258027008:12345-0@lo:400:kworker.0 Request processed in 48us (1702us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066022.568800:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789066022.568814:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789066022.568819:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258027136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066022.568846:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258027136:12345-0@lo:400:kworker.0 Request processed in 28us (1700us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066022.568852:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1789066022.568871:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789066022.568875:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789066022.568910:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07b0b2300 x1875971258027136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066022.568922:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258027136:0@lo:400:kworker.0 00010000:00080000:0.0:1789066022.568933:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9cf07b0b2d80 x1875971258027008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066038 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789066022.568942:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258027008:0@lo:400:kworker.0 00000100:00100000:1.0:1789066022.569167:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258026624:0@lo:400:kworker.0 00000100:00100000:2.0:1789066022.608002:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3294:x1875971258026880:12345-0@lo:8:kworker.0 Request processed in 39608us (40958us total) trans 0 rc -19/-19 00000100:00100000:2.0:1789066022.608015:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1789066022.610967:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789066022.610978:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789066022.610983:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258026880:0@lo:8:kworker.0 00010000:00010000:1.0:1789066022.757846:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066023.783851:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789066024.596956:0:15814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789066024.596960:0:15814:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789066024.597091:0:15814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9cf07b234800 00000020:01000004:1.0:1789066024.597106:0:15814:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789066024.597117:0:15814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789066024.597145:0:15814:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9cef41a019c0) 00000020:00000080:1.0:1789066024.597160:0:15814:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1789066024.634357:0:15814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789066024.634690:0:15814:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1789066024.636253:0:15814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789066024.636596:0:15814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1789066024.636997:0:15814:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1789066024.638638:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 423: rc = 0 00100000:10000000:3.0:1789066024.638981:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 423: rc = 0 00100000:10000000:3.0:1789066024.640334:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 423: rc = 0 00100000:10000000:3.0:1789066024.643253:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 566: rc = 0 00100000:10000000:3.0:1789066024.646361:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 566: rc = 0 00100000:10000000:3.0:1789066024.646733:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 566: rc = 0 00100000:10000000:3.0:1789066024.647007:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 566: rc = 0 00100000:10000000:3.0:1789066024.647293:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 566: rc = 0 00100000:10000000:2.0:1789066024.652112:0:15814:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 566: rc = 0 00000020:00000080:2.0:1789066024.653830:0:15814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789066024.653843:0:15814:0:(osd_handler.c:1574:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789066024.653859:0:15814:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7555615576c83856 00000020:01000004:2.0:1789066024.653868:0:15814:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789066024.653891:0:15814:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.123@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789066024.653895:0:15814:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.123@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789066024.653901:0:15814:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789066024.653923:0:15814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789066024.653928:0:15814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.123@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1789066024.700130:0:15814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.123@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789066024.700173:0:15814:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.123@tcp, index=0001, flags=0x20002 00000020:01000004:1.0:1789066024.700177:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789066024.700183:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789066024.700184:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789066024.700186:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789066024.700186:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789066024.700187:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789066024.700188:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789066024.700190:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789066024.700191:0:15814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789066024.700194:0:15814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:1.0:1789066024.700196:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789066024.700197:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789066024.700198:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789066024.700199:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789066024.700199:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789066024.700200:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789066024.700201:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789066024.700201:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789066024.700202:0:15814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789066024.700298:0:15814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789066024.700321:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027392:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789066024.700393:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066024.702264:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20ae40 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.703177:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027392 00000100:00100000:0.0:1789066024.703189:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027392 00000100:00100000:0.0:1789066024.703385:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789066024.703397:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15814:x1875971258027392:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789066024.705175:0:14405:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789066024.705198:0:14405:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789066024.705203:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789066024.732821:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15814:x1875971258027392:12345-0@lo:253:mount.lustre.0 Request processed in 29415us (32415us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.732835:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789066024.732972:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027392:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789066024.732988:0:15814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789066024.732992:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789066024.732993:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789066024.732995:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789066024.732996:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789066024.732997:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789066024.732998:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789066024.733000:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789066024.733002:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789066024.733003:0:15814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789066024.733028:0:15814:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9cf07b234800 from lustre-OST0001 10000000:01000000:1.0:1789066024.733074:0:15814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1789066024.733087:0:15814:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789066024.733097:0:15814:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9cf074ea99c0 local copy 00010000:00010000:1.0:1789066024.733121:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066024.733816:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027520:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789066024.734216:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066024.734265:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20a780 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.734579:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027520 00000100:00100000:0.0:1789066024.734587:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027520 00000100:00100000:0.0:1789066024.734643:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789066024.734653:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15814:x1875971258027520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066024.735200:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:15814:x1875971258027520:12345-0@lo:501:mount.lustre.0 Request processed in 546us (983us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789066024.735618:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027520:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789066024.735644:0:15814:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.123@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789066024.735828:0:15814:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.123@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789066024.735838:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066024.735862:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b048000/0x7555615576c83603 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8360a expref: -99 pid: 14394 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789066024.735890:0:15814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9cf07b234800 10000000:01000000:1.0:1789066024.735895:0:15814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789066024.735901:0:15814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789066024.735904:0:15814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789066024.735909:0:15814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789066024.735911:0:15814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789066024.735943:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066024.735951:0:15814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066024.735961:0:15814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066024.735992:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027648:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789066024.736032:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066024.736071:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20a780 going to sleep for 11 seconds 00000100:00100000:2.0:1789066024.736298:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027648 00000100:00100000:2.0:1789066024.736305:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027648 00000100:00100000:2.0:1789066024.736351:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1789066024.736360:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258027648:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789066024.736372:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066024.736385:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1d400/0x7555615576c83864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c8385d expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.736409:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1d400/0x7555615576c83864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c8385d expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.736440:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1d400/0x7555615576c83864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8385d expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.736448:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d400, rc 0) 00000100:00100000:2.0:1789066024.736493:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258027648:12345-0@lo:101:mount.lustre.0 Request processed in 135us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.736499:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789066024.736787:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789066024.736986:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027648:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789066024.737001:0:15814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83864 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066024.737012:0:15814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83864 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789066024.738191:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789066024.746128:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789066024.746456:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789066024.746507:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789066024.746543:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789066024.746628:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789066024.746668:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789066024.746720:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789066024.746792:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789066024.746801:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789066024.746914:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066024.746981:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.747017:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.747313:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027776 00000100:00100000:0.0:1789066024.747321:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027776 00000100:00100000:0.0:1789066024.747378:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789066024.747389:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258027776:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066024.748097:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258027776:12345-0@lo:501:mount.lustre.0 Request processed in 709us (1114us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.748108:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789066024.749052:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027776:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066024.749123:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027904:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789066024.749188:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.749225:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7540 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.749310:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258027904 00000100:00100000:0.0:1789066024.749319:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258027904 00000100:00100000:0.0:1789066024.749371:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789066024.749381:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258027904:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789066024.753097:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258027904:12345-0@lo:503:mount.lustre.0 Request processed in 3692us (3883us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.753113:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789066024.753391:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258027904:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1789066024.757365:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789066024.758278:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028032:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066024.758369:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.758488:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.758815:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028032 00000100:00100000:0.0:1789066024.758824:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028032 00000100:00100000:0.0:1789066024.759002:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789066024.759014:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258028032:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066024.759321:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258028032:12345-0@lo:502:mount.lustre.0 Request processed in 308us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.759330:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789066024.759440:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028032:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789066024.759997:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789066024.760059:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789066024.760107:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789066024.760156:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789066024.760191:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789066024.760222:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789066024.760270:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789066024.760306:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789066024.760352:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789066024.760399:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028160:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066024.760462:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.761139:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e7900 going to sleep for 11 seconds 00000100:00100000:3.0:1789066024.761241:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028160 00000100:00100000:3.0:1789066024.761248:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028160 00000100:00100000:3.0:1789066024.761292:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789066024.761300:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258028160:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789066024.761966:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d88450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258028160:12345-0@lo:502:mount.lustre.0 Request processed in 664us (1501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066024.761975:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789066024.762251:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028160:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789066024.762375:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789066024.762390:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789066024.764222:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789066024.764233:0:15815:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789066024.764241:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789066024.764243:0:15815:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789066024.764250:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789066024.764266:0:15815:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9cf07c034d40) 00000020:00000080:2.0:1789066024.764292:0:15815:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789066024.764299:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789066024.764377:0:15815:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07b234800 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789066024.764384:0:15815:0:(osd_handler.c:1574:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789066024.764396:0:15815:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x7555615576c83872 00010000:00010000:2.0:1789066024.772532:0:15815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789066024.773253:0:15815:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:2.0:1789066024.780263:0:15815:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1789066024.782867:0:15815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1789066024.782883:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789066024.786650:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066024.786659:0:15815:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1789066024.786674:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789066024.786681:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066024.786682:0:15815:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789066024.786686:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789066024.786688:0:15815:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789066024.786692:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789066024.786695:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066024.786696:0:15815:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789066024.786698:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789066024.786701:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066024.786702:0:15815:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789066024.786705:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789066024.786787:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789066024.786791:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789066024.786805:0:15815:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789066024.786809:0:15815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1789066024.787972:0:15814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789066024.788009:0:15814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789066024.788030:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83864 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.788044:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6000/0x7555615576c8385d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83864 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789066024.788052:0:15814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07b234800 from 1 10000000:01000000:2.0:1789066024.788055:0:15814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789066024.788102:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.788111:0:15814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.788123:0:15814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066024.788148:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028288:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789066024.788215:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.788250:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a7e70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.788957:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028288 00000100:00100000:0.0:1789066024.788969:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028288 00000100:00100000:0.0:1789066024.789019:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789066024.789029:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:15814:x1875971258028288:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789066024.789044:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066024.789060:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83879 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.789095:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83879 expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.789106:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83879 expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.789115:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07b049600, rc 0) 00000100:00100000:0.0:1789066024.789220:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d89c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028288:12345-0@lo:101:mount.lustre.0 Request processed in 191us (1004us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.789227:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789066024.795290:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028288:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789066024.795322:0:15814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066024.795335:0:15814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789066024.796152:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1789066024.799260:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789066024.805045:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1789066024.805162:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1789066024.805250:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1789066024.805260:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1789066024.805369:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028416:0@lo:501:mount.lustre.0 00010000:00010000:2.0:1789066024.807099:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789066024.809713:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066024.809817:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789066024.815139:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028416 00000100:00100000:2.0:1789066024.815157:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028416 00000100:00100000:2.0:1789066024.815263:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789066024.815286:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028416:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789066024.816106:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028416:12345-0@lo:501:mount.lustre.0 Request processed in 831us (6399us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.816118:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789066024.816336:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028416:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789066024.816396:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028544:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789066024.816949:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066024.817038:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07b20acc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789066024.817076:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028544 00000100:00100000:2.0:1789066024.817093:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028544 00000100:00100000:2.0:1789066024.817165:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789066024.817174:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028544:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789066024.817713:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028544:12345-0@lo:503:mount.lustre.0 Request processed in 538us (763us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.817721:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789066024.818024:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028544:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789066024.819321:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789066024.819498:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028672:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789066024.820002:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066024.821801:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.822008:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028672 00000100:00100000:0.0:1789066024.822018:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028672 00000100:00100000:0.0:1789066024.822070:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789066024.822090:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066024.822625:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028672:12345-0@lo:502:mount.lustre.0 Request processed in 544us (2623us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.822635:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789066024.822763:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789066024.823197:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1789066024.823256:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1789066024.823580:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1789066024.823627:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1789066024.823660:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1789066024.823710:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1789066024.823744:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1789066024.823774:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:3.0:1789066024.823826:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028800:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789066024.824051:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066024.824104:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b780 going to sleep for 11 seconds 00000100:00100000:2.0:1789066024.824378:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028800 00000100:00100000:2.0:1789066024.824385:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028800 00000100:00100000:2.0:1789066024.824439:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789066024.824448:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028800:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066024.824715:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028800:12345-0@lo:502:mount.lustre.0 Request processed in 267us (664us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.824723:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1789066024.827019:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028800:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789066024.827235:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1789066024.827256:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1789066024.830945:0:15819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789066024.830959:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066024.830962:0:15819:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1789066024.830971:0:15819:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf07b234800 00000020:00000080:3.0:1789066024.830973:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789066024.830981:0:15819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789066024.830983:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066024.830984:0:15819:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1789066024.830987:0:15819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789066024.830989:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066024.830991:0:15819:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1789066024.830994:0:15819:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9cf07b234800 00000020:00000080:3.0:1789066024.831004:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789066024.831076:0:15819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789066024.831092:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066024.831093:0:15819:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1789066024.831097:0:15819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789066024.831100:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066024.831101:0:15819:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789066024.831105:0:15819:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9cf07b234800 00000020:00000080:3.0:1789066024.831107:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1789066024.831149:0:15819:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789066024.831153:0:15819:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789066024.831154:0:15819:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789066024.831158:0:15819:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1789066024.844069:0:15814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1789066024.844128:0:15814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789066024.844158:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.844173:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066024.844229:0:15814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789066024.844233:0:15814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9cf07b234800 10000000:01000000:0.0:1789066024.844236:0:15814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9cf07b234800 10000000:01000000:0.0:1789066024.844241:0:15814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789066024.844246:0:15814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9cf07b234800 from 1 10000000:01000000:0.0:1789066024.844249:0:15814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789066024.844289:0:15814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.844299:0:15814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.844312:0:15814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066024.844339:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028928:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789066024.844933:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.844989:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051703a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789066024.845073:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258028928 00000100:00100000:2.0:1789066024.845094:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258028928 00000100:00100000:2.0:1789066024.845147:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789066024.845156:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258028928:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789066024.845169:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066024.845184:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c8388e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83887 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.845211:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c8388e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83887 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.845229:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1ca00/0x7555615576c8388e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83887 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.845237:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ca00, rc 0) 00000100:00100000:2.0:1789066024.845281:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258028928:12345-0@lo:101:mount.lustre.0 Request processed in 126us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.845288:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789066024.845834:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258028928:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789066024.845991:0:15814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8388e expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.846002:0:15814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c8388e expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789066024.851000:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1789066024.854734:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789066024.855262:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1789066024.855307:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1789066024.855338:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1789066024.855380:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1789066024.855810:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1789066024.855891:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1789066024.855928:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1789066024.855960:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1789066024.856195:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1789066024.856236:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1789066024.856271:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1789066024.856316:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1789066024.856349:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1789066024.856381:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1789066024.856442:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1789066024.856504:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1789066024.856539:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1789066024.856700:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1789066024.856739:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1789066024.856772:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1789066024.856821:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1789066024.856941:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1789066024.856979:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1789066024.857027:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1789066024.857062:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1789066024.857111:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1789066024.857158:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1789066024.857191:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1789066024.857221:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1789066024.857285:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:0.0:1789066024.857323:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:0.0:1789066024.857355:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:0.0:1789066024.857386:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:0.0:1789066024.857438:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:0.0:1789066024.857477:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:0.0:1789066024.857526:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:0.0:1789066024.858111:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:0.0:1789066024.858229:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:0.0:1789066024.858238:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1789066024.858347:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066024.858712:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.858766:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051703a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066024.858830:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029056 00000100:00100000:1.0:1789066024.858915:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029056 00000100:00100000:1.0:1789066024.858972:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789066024.858982:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029056:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789066024.859338:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029056:12345-0@lo:501:mount.lustre.0 Request processed in 355us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066024.859348:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789066024.863054:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029056:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789066024.863178:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029184:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789066024.863266:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.863350:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051703a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066024.870352:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029184 00000100:00100000:1.0:1789066024.870370:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029184 00000100:00100000:1.0:1789066024.870483:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789066024.870503:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029184:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789066024.871128:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029184:12345-0@lo:503:mount.lustre.0 Request processed in 626us (7860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066024.871138:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789066024.876994:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029184:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789066024.879134:0:15814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789066024.879271:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789066024.879355:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.879405:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf051703a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066024.880032:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029312 00000100:00100000:1.0:1789066024.880041:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029312 00000100:00100000:1.0:1789066024.880113:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789066024.880125:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789066024.880501:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029312:12345-0@lo:502:mount.lustre.0 Request processed in 366us (1134us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066024.880513:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789066024.881745:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b1c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789066024.882250:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789066024.882316:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789066024.882347:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789066024.882389:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789066024.884177:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789066024.884260:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789066024.884301:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789066024.884338:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789066024.884386:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789066024.885060:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789066024.885127:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789066024.885186:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789066024.885225:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789066024.885261:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789066024.885308:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789066024.885343:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789066024.885376:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789066024.885475:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789066024.885529:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789066024.885604:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789066024.885659:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789066024.885699:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789066024.885729:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789066024.885772:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789066024.885804:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789066024.885831:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789066024.885890:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789066024.885934:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789066024.885963:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789066024.886006:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789066024.886037:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789066024.886069:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789066024.886114:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789066024.886208:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789066024.886249:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789066024.886307:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789066024.886341:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789066024.886375:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789066024.886424:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789066024.886461:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789066024.886543:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066024.886695:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.886764:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029440 00000100:00100000:2.0:1789066024.886775:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029440 00000100:00100000:2.0:1789066024.888366:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789066024.888389:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029440:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789066024.889171:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258029440:12345-0@lo:502:mount.lustre.0 Request processed in 791us (2475us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.889182:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789066024.889262:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1dae40 going to sleep for 11 seconds 00000100:00100000:2.0:1789066024.889288:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258029440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789066024.889400:0:15814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789066024.889679:0:15814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1789066024.892011:0:15824:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1789066024.892030:0:15824:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9cf07c0319c0) 00000020:00000080:2.0:1789066024.892057:0:15824:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:2.0:1789066024.892183:0:15824:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9cf07b234800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789066024.892187:0:15824:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9cf07b234800 from lustre-OST0001, refs=3 00000020:01000004:2.0:1789066024.892190:0:15824:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9cf07b234800 3 00010000:00080000:2.0:1789066024.892223:0:15824:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9cef43106000@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.123@tcp at head 00010000:00010000:2.0:1789066024.895276:0:15824:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1789066024.895627:0:15824:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1789066024.895673:0:15824:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789066024.895689:0:15824:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x7555615576c8389c 00000100:00080000:2.0:1789066024.895699:0:15824:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789066024.895709:0:15824:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9cef43106000 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789066024.895747:0:15824:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433bbb80 x1875971258029568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789066024.895772:0:15824:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789066024.896690:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789066024.896695:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789066024.896698:0:37:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789066024.896703:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 481 00000100:00080000:2.0:1789066024.896707:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:2.0:1789066024.896715:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf07b233800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:2.0:1789066024.896731:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cef433b9880 x1875971258029824/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789066024.896787:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3294:1875971258029568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789066024.896986:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258029696:0@lo:400:kworker.0 00000100:00100000:1.0:1789066024.897043:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.897130:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.897165:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258029824:0@lo:8:kworker.0 00000100:00100000:2.0:1789066024.897187:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066024.897256:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029568 00000100:00100000:1.0:1789066024.897263:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029568 00000100:00100000:1.0:1789066024.897303:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789066024.897310:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3294:x1875971258029568:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789066024.897338:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:1.0:1789066024.897376:0:14411:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x7555615576c838a3 00000004:00100000:1.0:1789066024.897390:0:14411:0:(mdt_handler.c:7356:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789066024.897431:0:14411:0:(import.c:65:import_set_state_nolock()) ffff9cef42ea9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789066024.897506:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3294:x1875971258029568:12345-0@lo:38:llog_process_th.0 Request processed in 194us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066024.897522:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789066024.897601:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef433bbb80 x1875971258029568/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789066034 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066024.897612:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789066024.897620:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1789066024.897628:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789066024.897633:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789066024.897635:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cef43106000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789066024.897642:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3294:1875971258029568:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789066024.900157:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258029952:0@lo:400:kworker.0 00000100:00100000:0.0:1789066024.900228:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.900322:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789066024.900331:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258030080:0@lo:400:kworker.0 00000100:00100000:0.0:1789066024.900355:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.902085:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029696 00000100:00100000:0.0:1789066024.902099:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029696 00000100:00100000:2.0:1789066024.902267:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029952 00000100:00100000:2.0:1789066024.902278:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029952 00000100:00100000:2.0:1789066024.902333:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030080 00000100:00100000:2.0:1789066024.902336:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030080 00000100:00100000:0.0:1789066024.902403:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258029824 00000100:00100000:0.0:1789066024.902407:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258029824 00000100:00100000:0.0:1789066024.902437:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789066024.902447:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258029696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066024.902543:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258029696:12345-0@lo:400:kworker.0 Request processed in 97us (5499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.902566:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789066024.902583:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789066024.902752:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3294:x1875971258029824:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1789066024.902806:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3294:x1875971258029824:12345-0@lo:8:kworker.0 Request processed in 54us (5617us total) trans 0 rc -11/-11 00000100:00100000:0.0:1789066024.902812:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789066024.902953:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789066024.902964:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258029952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066024.903010:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258029952:12345-0@lo:400:kworker.0 Request processed in 49us (2782us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066024.903016:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789066024.903172:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789066024.903181:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258030080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789066024.903217:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258030080:12345-0@lo:400:kworker.0 Request processed in 38us (2861us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066024.903224:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789066024.903402:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789066024.903407:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789066024.903893:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258029696:0@lo:400:kworker.0 00000100:00100000:1.0:1789066024.905006:0:3294:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789066024.905017:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789066024.905022:0:3294:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789066024.905026:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258029824:0@lo:8:kworker.0 00010000:00080000:1.0:1789066024.905141:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef433bad80 x1875971258030080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066024.905153:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258030080:0@lo:400:kworker.0 00010000:00080000:1.0:1789066024.905167:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cef433bb100 x1875971258029952/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066024.905197:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258029952:0@lo:400:kworker.0 00000040:00080000:2.0:1789066024.905443:0:15824:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1789066024.905910:0:15814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1789066024.905943:0:15814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789066024.905963:0:15814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8388e expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066024.905975:0:15814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf07b049a00/0x7555615576c83887 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c8388e expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789066024.906024:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789066024.906026:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789066024.906028:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789066024.906029:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789066024.906030:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789066024.906031:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789066024.906033:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789066024.906034:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789066024.906035:0:15814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789066024.906039:0:15814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1789066024.906041:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789066024.906151:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789066024.906152:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789066024.906153:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789066024.906159:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789066024.906160:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789066024.906161:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789066024.906162:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789066024.906163:0:15814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789066024.906188:0:15814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789066024.906206:0:15814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258030208:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789066024.906277:0:15814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066024.906322:0:15814:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf04c1da180 going to sleep for 11 seconds 00000100:00100000:1.0:1789066024.906410:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030208 00000100:00100000:1.0:1789066024.906429:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030208 00000100:00100000:1.0:1789066024.906483:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789066024.906500:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:15814:x1875971258030208:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789066024.906526:0:14405:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789066024.906539:0:14405:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789066024.990253:0:14405:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789066024.990274:0:14405:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1789066024.993059:0:14428:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789066024.993070:0:14428:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789066024.993104:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993123:0:14428:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c8377d expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993150:0:14428:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993192:0:14428:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c8377d expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993205:0:14428:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c8377d expref: 19 pid: 14406 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066024.993221:0:14428:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14428:1875971258030336:0@lo:104: 00000100:00100000:0.0:1789066024.993296:0:14428:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.993349:0:14428:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf0517033c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789066024.993381:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030336 00000100:00100000:0.0:1789066024.993389:0:14395:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030336 00000100:00100000:0.0:1789066024.993435:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789066024.993443:0:14395:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14428:x1875971258030336:12345-0@lo:104: 00010000:00010000:0.0:1789066024.993457:0:14395:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993519:0:14395:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789066024.993525:0:14395:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:14428:x1875971258030336:12345-0@lo:104: Request processed in 83us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.993532:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789066024.993603:0:14428:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b2300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14428:1875971258030336:0@lo:104: 00010000:00010000:0.0:1789066024.993621:0:14428:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993638:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066024.993651:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993658:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c400 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789066024.993662:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993670:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789066024.993677:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066024.993684:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789066024.993712:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993719:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789066024.993740:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993747:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1c400/0x7555615576c8377d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c83784 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993763:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066024.993765:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066024.993766:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789066024.993789:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258030464:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066024.993819:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066024.993891:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030464 00000100:00100000:0.0:1789066024.993901:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030464 00010000:00010000:0.0:1789066024.993919:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8377d expref: 20 pid: 14406 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066024.993942:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789066024.993950:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+20:3295:x1875971258030464:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789066024.993962:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066024.993968:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c8377d expref: 20 pid: 14406 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993979:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c8377d expref: 20 pid: 14406 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.993993:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf081654000/0x7555615576c83784 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c8377d expref: 20 pid: 14406 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994006:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994014:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789066024.994029:0:14398:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002446637s 00010000:00010000:0.0:1789066024.994034:0:14398:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994041:0:14398:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994049:0:14398:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994067:0:14398:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994073:0:14398:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066024.994088:0:14398:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994096:0:14398:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994110:0:14398:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994120:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066024.994151:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258030464:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066024.994158:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1789066024.994181:0:14428:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994189:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066024.994195:0:14428:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07b048c00/0x7555615576c838aa lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14428 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066024.994224:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258030464:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789066025.010203:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:15814:x1875971258030208:12345-0@lo:253:mount.lustre.0 Request processed in 103693us (103914us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066025.010221:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789066025.013812:0:15814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:15814:1875971258030208:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789066025.014195:0:15814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789066025.014200:0:15814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789066025.014202:0:15814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789066025.014204:0:15814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789066025.014205:0:15814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789066025.014207:0:15814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789066025.014208:0:15814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789066025.014210:0:15814:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789066025.014212:0:15814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789066025.014213:0:15814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789066025.014238:0:15814:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789066025.025444:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789066025.028297:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789066025.029166:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789066025.029371:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789066025.029813:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789066025.030188:0:15814:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789066025.035975:0:15814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1789066025.116978:0:15814:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789066025.116988:0:15814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789066025.117031:0:15814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789066025.117164:0:15814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.123@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789066025.117191:0:15814:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789066025.117228:0:15814:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00000040:00080000:0.0:1789066025.255356:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789066025.830075:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066026.855790:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789066026.856733:0:14409:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789066026.856739:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9cf07f2f7000 from 8 10000000:01000000:1.0:1789066026.856744:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789066026.856790:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066026.856803:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066026.856815:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066026.856840:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258030592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789066026.856914:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066026.856967:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fccd80 going to sleep for 11 seconds 00000100:00100000:2.0:1789066026.857091:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030592 00000100:00100000:2.0:1789066026.857100:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030592 00000100:00100000:2.0:1789066026.857315:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789066026.857326:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07eda4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258030592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789066026.857342:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066026.857356:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1c400/0x7555615576c838b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c838b1 expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066026.857383:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1c400/0x7555615576c838b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c838b1 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066026.857394:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1c400/0x7555615576c838b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c838b1 expref: 19 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066026.857401:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c400, rc 0) 00000100:00100000:2.0:1789066026.857454:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07eda4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258030592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (539us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066026.857463:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789066026.858114:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258030592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789066026.858143:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c838b8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066026.858154:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c838b8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066026.858206:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258030720:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789066026.858244:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066026.858426:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030720 00000100:00100000:0.0:1789066026.858433:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030720 00000100:00100000:0.0:1789066026.858476:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789066026.858485:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258030720:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789066026.858499:0:14405:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789066026.858515:0:14405:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789066026.858519:0:14405:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1789066026.858616:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258030720:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 132us (371us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066026.858622:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789066026.858923:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066026.858939:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258030720:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789066026.859208:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789066026.859217:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c838b8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066026.859227:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0817a6c00/0x7555615576c838b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c838b8 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066027.685767:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789066027.685791:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258030848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789066027.685861:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066027.686100:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030848 00000100:00100000:1.0:1789066027.686110:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030848 00000100:00100000:1.0:1789066027.686190:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789066027.686200:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258030848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789066027.686252:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789066027.686303:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258030848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066027.686311:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789066027.686454:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258030848:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789066027.686580:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789066027.877829:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066028.905840:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066029.926731:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789066030.245836:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789066030.245843:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789066030.245848:0:38:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789066030.245864:0:38:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9cf07b233800 using connection 192.168.204.123@tcp/0@lo 00000100:00100000:3.0:1789066030.245888:0:38:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9cf07f70ce00 x1875971258031232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789066030.245948:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258031360:0@lo:400:kworker.0 00000100:00100000:3.0:1789066030.246021:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066030.246081:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789066030.246087:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258031488:0@lo:400:kworker.0 00000100:00100000:3.0:1789066030.246108:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066030.246153:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031360 00000100:00100000:3.0:1789066030.246161:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031360 00000100:00100000:3.0:1789066030.246202:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031488 00000100:00100000:3.0:1789066030.246205:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031488 00000100:00100000:3.0:1789066030.246235:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789066030.246244:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258031360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066030.246295:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258031360:12345-0@lo:400:kworker.0 Request processed in 52us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066030.246302:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789066030.246316:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789066030.246322:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258031488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066030.246349:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258031488:12345-0@lo:400:kworker.0 Request processed in 27us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066030.246355:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789066030.246390:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70c000 x1875971258031488/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789066030.246403:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258031488:0@lo:400:kworker.0 00010000:00080000:3.0:1789066030.246413:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70ea00 x1875971258031360/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789066030.246421:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258031360:0@lo:400:kworker.0 00000100:00100000:1.0:1789066030.246507:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3297:1875971258030976:0@lo:400:kworker.0 00000100:00100000:1.0:1789066030.246581:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.246609:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258031616:0@lo:400:kworker.0 00000100:00100000:1.0:1789066030.246630:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.246645:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789066030.246650:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258031104:0@lo:400:kworker.0 00000100:00100000:1.0:1789066030.246672:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.246700:0:3294:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258031232:0@lo:8:kworker.0 00000100:00100000:1.0:1789066030.246721:0:3294:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.246750:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031104 00000100:00100000:1.0:1789066030.246754:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031104 00000100:00100000:1.0:1789066030.246778:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031232 00000100:00100000:1.0:1789066030.246781:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031232 00000100:00100000:1.0:1789066030.246799:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789066030.246805:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258031104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066030.246839:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258031104:12345-0@lo:400:kworker.0 Request processed in 34us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066030.246845:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789066030.246859:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789066030.246863:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3294:x1875971258031232:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789066030.246885:0:15097:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 489 last 0 00000020:00000080:1.0:1789066030.246911:0:15097:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x7555615576c838bf 00002000:00100000:1.0:1789066030.246924:0:15097:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9cef42ead800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a28 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789066030.246928:0:15097:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789066030.246931:0:15097:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789066030.247263:0:15097:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789066030.247285:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9cef42eaf800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789066030.247335:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3294:x1875971258031232:12345-0@lo:8:kworker.0 Request processed in 469us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066030.247342:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1789066030.247379:0:3294:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70ce00 x1875971258031232/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789066055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789066030.247392:0:3294:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789066030.247401:0:3294:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789066030.247406:0:3294:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789066030.247408:0:3294:0:(import.c:65:import_set_state_nolock()) ffff9cf07b233800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789066030.247420:0:3294:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789066030.247424:0:3294:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3294:1875971258031232:0@lo:8:kworker.0 00000004:00080000:1.0:1789066030.247463:0:14438:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:1.0:1789066030.247477:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b269180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1875971258031872:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789066030.247501:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.247515:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066030.247535:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258031104:0@lo:400:kworker.0 00000100:00100000:1.0:1789066030.247544:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789066030.247569:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258031744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789066030.247592:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.247619:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031744 00000100:00100000:1.0:1789066030.247624:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031744 00000100:00100000:1.0:1789066030.247648:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789066030.247654:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258031744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789066030.247671:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789066030.247705:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258031744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (112us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066030.247720:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789066030.247747:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07b268e00 x1875971258031744/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789066046 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066030.247761:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258031744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789066030.247777:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031872 00000100:00100000:1.0:1789066030.247780:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031872 00000100:00100000:1.0:1789066030.247799:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789066030.247804:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14438:x1875971258031872:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789066030.249495:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258031616 00000100:00100000:2.0:1789066030.249506:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258031616 00000100:00100000:2.0:1789066030.249593:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789066030.249603:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258031616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789066030.249681:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258031616:12345-0@lo:400:kworker.0 Request processed in 80us (3049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066030.249687:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1789066030.249713:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789066030.249718:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789066030.249720:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00080000:2.0:1789066030.249735:0:14437:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789066030.250142:0:14437:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 489443592365ns, next at 0ns, rc = 0 00010000:00080000:2.0:1789066030.250775:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70d880 x1875971258031616/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066046 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789066030.250790:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258031616:0@lo:400:kworker.0 00000100:00100000:3.0:1789066030.253703:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258030976 00000100:00100000:3.0:1789066030.253718:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258030976 00000100:00100000:3.0:1789066030.253790:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789066030.253802:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3297:x1875971258030976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066030.253892:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed61050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3297:x1875971258030976:12345-0@lo:400:kworker.0 Request processed in 92us (7308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066030.253911:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789066030.254000:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3297:1875971258030976:0@lo:400:kworker.0 00002000:00080000:1.0:1789066030.274728:0:15097:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789066030.275146:0:15097:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:1.0:1789066030.275154:0:15097:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1789066030.297371:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.297383:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297401:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.297406:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.297413:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297431:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297443:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297463:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297486:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.297500:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.297507:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297514:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.297519:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297528:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297545:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297589:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.297608:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.297610:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.297612:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.308129:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.308151:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308169:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.308175:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.308181:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308195:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308206:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308215:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308304:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.308319:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.308326:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308334:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.308338:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308349:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308376:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308385:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.308400:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.308402:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.308403:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.309288:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.309297:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.309307:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.309311:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.309316:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.309327:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.309336:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.309343:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.309422:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789066030.313311:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.313325:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.313342:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.313346:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.313352:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.313367:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.313378:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.313386:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.318357:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789066030.318373:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.318388:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.318393:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.318404:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.318431:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.318444:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c838d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.322566:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.322580:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.322595:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.322600:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.322612:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.322635:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.322655:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.322657:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.322660:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.324311:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1789066030.324326:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.324370:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.326666:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.326690:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326709:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.326715:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.326722:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326739:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326750:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326758:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326779:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.326793:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.326800:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326808:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.326813:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326821:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326846:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326854:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083530397/0x7555615576c838e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.326874:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.326877:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.326879:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.327806:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.327814:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327824:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.327828:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.327833:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327841:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327850:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327856:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327882:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.327892:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.327897:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327903:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.327906:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327913:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327926:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327933:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013f964cb/0x7555615576c838e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.327948:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.327950:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.327951:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.328778:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.328786:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.328796:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.328807:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.328812:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.328822:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.328830:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.328837:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.328862:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.328904:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.328918:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.328928:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.328935:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.328970:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.328999:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.329010:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ac368be/0x7555615576c838f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.329035:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.329038:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.329039:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.329805:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.329814:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.329823:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.329826:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.329831:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.329842:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.329850:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.329863:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.329876:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.330589:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.330597:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330607:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.330611:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330621:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789066030.330643:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.330648:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.330651:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.330668:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.330674:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.330684:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330685:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e0b3685/0x7555615576c838f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.330708:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.330719:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330720:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.330723:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.330727:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.330729:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.330745:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.330873:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.330879:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330888:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.330891:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330900:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330913:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330920:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000986163a3/0x7555615576c838fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.330937:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.330945:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.330948:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.331454:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.331462:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331477:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.331480:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.331496:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331507:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331514:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331521:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331537:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.331682:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.331688:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331695:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.331698:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331704:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331726:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331732:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000010a021dc/0x7555615576c83905 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.331747:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.331748:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.331750:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789066030.332424:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789066030.332431:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.332440:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=489s v=(0 0) 00010000:00010000:1.0:1789066030.332444:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066030.332448:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.332456:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.332463:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.332469:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.332660:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.332926:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.332933:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.332949:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.332953:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.332961:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.332985:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.332994:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004b2f33ed/0x7555615576c8390c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.333010:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.333011:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.333013:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.337860:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.337876:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.337894:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.337900:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.337906:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.337936:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.337947:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.337956:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.337987:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789066030.338498:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.338505:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338515:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.338518:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.338522:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338532:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338541:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338575:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338592:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789066030.338605:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789066030.338611:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338619:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.338625:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338636:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338654:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338663:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077edd5d8/0x7555615576c83913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338685:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.338689:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338707:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b048400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.338711:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338720:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338733:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338741:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c4711b45/0x7555615576c8391a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.338756:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789066030.338757:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1789066030.338759:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.338763:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.339191:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.339197:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339205:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.339208:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.339212:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339220:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339233:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339239:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339252:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.339261:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.339264:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339271:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.339274:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339282:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339292:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339299:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c488b74/0x7555615576c83921 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.339310:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.339317:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.339319:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.341301:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.345628:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.345640:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345659:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.345664:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.345671:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345688:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345699:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345708:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345730:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.345745:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.345751:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345761:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07b049c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.345766:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.345790:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.347310:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.347336:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a047aa4c/0x7555615576c83928 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.347371:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.347373:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.347375:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.348030:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.348039:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348052:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.348057:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.348064:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348076:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348085:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348100:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348121:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789066030.348135:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066030.348140:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348148:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066030.348153:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348162:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348179:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348186:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097aa156c/0x7555615576c8392f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.348202:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.348204:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.348206:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789066030.351231:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:0.0:1789066030.352177:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.352201:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.352909:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.352918:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.352926:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.352947:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.352960:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.352968:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.353052:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789066030.354505:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.354519:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.354540:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.354545:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.354569:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.354583:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.354602:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.354611:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.355202:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789066030.358577:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358611:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.358619:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358634:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358664:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358672:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059625ee9/0x7555615576c83936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358710:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.358714:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358721:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.358725:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358745:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358756:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.358765:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.358767:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.358770:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.359379:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789066030.359389:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069cccfa2/0x7555615576c8393d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.359500:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.360890:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.360902:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.360920:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.360924:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.360930:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.360946:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.360957:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.360986:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.361043:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789066030.361492:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.361498:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.361508:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.361511:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.361516:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.361527:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.361535:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.361542:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361756:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789066030.361763:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361772:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655c00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.361777:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361786:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361803:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361810:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009452e143/0x7555615576c83944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361840:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.361844:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361850:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.361853:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361861:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361870:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.361877:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.361879:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.361881:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.363659:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1789066030.363673:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e3122b59/0x7555615576c8394b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789066030.365153:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.365191:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.365208:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.365214:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.365228:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.365244:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066030.365284:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.365295:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.365304:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.365320:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.365475:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.365483:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.365495:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.365499:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.365518:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.365536:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.365544:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097b4dd8e/0x7555615576c83952 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.365744:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.365746:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.365748:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.366086:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.366093:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366101:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.366104:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.366114:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366123:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366131:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366137:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366158:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.366243:0:14400:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.366249:0:14400:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.366257:0:14400:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.366260:0:14400:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.366268:0:14400:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.366281:0:14400:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.366300:0:14400:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e15eed0b/0x7555615576c83959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.366314:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.366315:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.366322:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.366955:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.366962:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366981:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.366984:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.366988:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.366997:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.367006:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.367024:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.367039:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.367102:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.367107:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.367115:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.367118:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.367126:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.367140:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.367147:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000080bc4a0d/0x7555615576c83960 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.367169:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.367170:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.367172:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.369377:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.369389:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.369407:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.369412:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.369418:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.373655:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.373689:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.373699:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.373738:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789066030.374479:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.374488:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.374509:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.374513:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.374519:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.374533:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.374542:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.374575:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.374596:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789066030.374606:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789066030.374616:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374626:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.374631:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374642:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374660:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374667:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004000f815/0x7555615576c83967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374688:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.374692:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374699:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.374703:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374711:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374735:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374742:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024854eaf/0x7555615576c8396e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.374759:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.374762:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.374764:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.375017:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.375024:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375032:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.375035:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.375040:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375049:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375069:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375076:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375094:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.375100:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.375106:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375114:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.375118:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375126:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375138:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375146:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afa73ec5/0x7555615576c83975 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789066030.375482:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.375487:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375496:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.375499:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.375504:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375512:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375520:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375527:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.375573:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.375707:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.375711:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375717:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654a00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.375720:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375727:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375739:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375747:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000727c7e84/0x7555615576c8397c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.375760:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.375762:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.375764:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789066030.376003:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789066030.376009:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.376017:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=489s v=(0 0) 00010000:00010000:0.0:1789066030.376020:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066030.376024:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.376034:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.376042:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.376050:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066030.376068:0:15097:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789066030.376075:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789066030.376081:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.376088:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655400 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066030.376098:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.376106:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.376118:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.376126:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bc33b926/0x7555615576c83983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066030.376146:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.376148:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066030.376150:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789066030.376256:0:15097:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1789066030.376349:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:14438:x1875971258031872:12345-0@lo:5:osp-pre-1-0.0 Request processed in 128540us (128844us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066030.376358:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789066030.376412:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b269180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1875971258031872:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789066030.376436:0:14438:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00010000:00010000:3.0:1789066030.376516:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789066030.403844:0:14438:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1875971258032000:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789066030.403912:0:14438:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066030.403969:0:14438:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050fcc900 going to sleep for 11 seconds 00000100:00100000:2.0:1789066030.404524:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032000 00000100:00100000:2.0:1789066030.404533:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032000 00000100:00100000:2.0:1789066030.404611:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789066030.404622:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:14438:x1875971258032000:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:2.0:1789066030.404672:0:15096:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:2.0:1789066030.418914:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14438:x1875971258032000:12345-0@lo:5:osp-pre-1-0.0 Request processed in 14285us (14992us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789066030.418928:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789066030.420383:0:14438:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14438:1875971258032000:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1789066030.420401:0:14438:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:2.0:1789066030.949755:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066031.973817:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789066032.337204:0:16171:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg423-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1789066032.806732:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258032128:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789066032.806805:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066032.806893:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032128 00000100:00100000:3.0:1789066032.806902:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032128 00000100:00100000:3.0:1789066032.806965:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789066032.806975:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258032128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789066032.807009:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789066032.807055:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258032128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066032.807062:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789066032.807082:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789066032.807115:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258032128:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789066032.998685:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789066034.025107:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066035.045640:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066035.187414:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066035.194003:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236013824 00000100:00100000:0.0:1789066035.194020:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236013824 00000100:00100000:0.0:1789066035.194175:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:0.0:1789066035.194187:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2346:x1875971236013824:12345-192.168.204.23@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789066035.194230:0:14405:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 0e8af51c-f770-41ac-8f86-9bd33864d1bb@192.168.204.23@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:0.0:1789066035.194263:0:14405:0:(genops.c:1384:class_connect()) connect: client 0e8af51c-f770-41ac-8f86-9bd33864d1bb, cookie 0x7555615576c8398a 00000100:00080000:0.0:1789066035.194462:0:14405:0:(import.c:65:import_set_state_nolock()) ffff9cef4339e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789066035.194734:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+5:2346:x1875971236013824:12345-192.168.204.23@tcp:250:mount.lustre.0 Request processed in 546us (7335us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.194743:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 75 00000100:00100000:0.0:1789066035.202082:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.202612:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236013952 00000100:00100000:3.0:1789066035.202629:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236013952 00000100:00100000:3.0:1789066035.202703:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:3.0:1789066035.202715:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+5:13751:x1875971236013952:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789066035.202732:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066035.202751:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040031a00/0x7555615576c83991 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce01d expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066035.202781:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031a00/0x7555615576c83991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce01d expref: 6 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066035.202811:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040031a00/0x7555615576c83991 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce01d expref: 6 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066035.202820:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031a00, rc 0) 00000100:00100000:3.0:1789066035.203597:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed60050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+6:13751:x1875971236013952:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 880us (1524us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.203607:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 76 00000100:00100000:1.0:1789066035.223004:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066035.223215:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014080 00000100:00100000:0.0:1789066035.223235:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014080 00000100:00100000:0.0:1789066035.223317:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:0.0:1789066035.223330:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+6:13751:x1875971236014080:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789066035.224060:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed63050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+6:13751:x1875971236014080:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 729us (1069us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789066035.224071:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 77 00000100:00100000:0.0:1789066035.230315:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.230438:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014208 00000100:00100000:3.0:1789066035.230461:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014208 00000100:00100000:3.0:1789066035.230657:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:3.0:1789066035.230670:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+6:13751:x1875971236014208:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789066035.230695:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066035.230725:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf040031c00/0x7555615576c83998 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce024 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066035.230779:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031c00/0x7555615576c83998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce024 expref: 7 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066035.230803:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf040031c00/0x7555615576c83998 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce024 expref: 7 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066035.230815:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031c00, rc 0) 00000100:00100000:3.0:1789066035.230923:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+7:13751:x1875971236014208:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 254us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.230931:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 78 00000100:00100000:1.0:1789066035.241675:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066035.242048:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014336 00000100:00100000:0.0:1789066035.242062:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014336 00000100:00100000:0.0:1789066035.242138:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:0.0:1789066035.242150:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+7:13751:x1875971236014336:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789066035.242618:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed63c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13751:x1875971236014336:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 468us (957us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.242627:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 79 00000100:00100000:1.0:1789066035.248228:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.248738:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014464 00000100:00100000:3.0:1789066035.248804:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014464 00000100:00100000:3.0:1789066035.249061:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:3.0:1789066035.249076:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13751:x1875971236014464:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789066035.249466:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed60450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13751:x1875971236014464:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 391us (1252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.249476:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 80 00000100:00100000:3.0:1789066035.254076:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066035.254622:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014592 00000100:00100000:2.0:1789066035.254638:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014592 00000100:00100000:2.0:1789066035.254720:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:2.0:1789066035.254733:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ed62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13769:x1875971236014592:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789066035.255199:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ed62c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13769:x1875971236014592:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 466us (1135us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066035.255209:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 81 00000100:00100000:1.0:1789066035.278184:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066035.279222:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014720 00000100:00100000:0.0:1789066035.279241:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014720 00000100:00100000:0.0:1789066035.279344:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:0.0:1789066035.279359:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13769:x1875971236014720:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789066035.279994:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13769:x1875971236014720:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 634us (1824us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.280005:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 82 00000100:00100000:1.0:1789066035.288189:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066035.288651:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014848 00000100:00100000:2.0:1789066035.288666:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014848 00000100:00100000:2.0:1789066035.288750:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:2.0:1789066035.288762:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+8:13751:x1875971236014848:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789066035.288805:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066035.288835:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c8399f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce04e expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.288892:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c8399f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce04e expref: 9 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.288908:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1ce00/0x7555615576c8399f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce04e expref: 9 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.288919:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1ce00, rc 0) 00000100:00100000:2.0:1789066035.289001:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+9:13751:x1875971236014848:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 241us (827us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066035.289009:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 83 00000100:00100000:2.0:1789066035.300198:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.300321:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236014976 00000100:00100000:3.0:1789066035.300337:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236014976 00000100:00100000:3.0:1789066035.300441:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:3.0:1789066035.300453:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+9:13751:x1875971236014976:12345-192.168.204.23@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789066035.300492:0:14406:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789066035.300528:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789066035.300534:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789066035.300538:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789066035.300541:0:14406:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789066035.302311:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+9:13751:x1875971236014976:12345-192.168.204.23@tcp:256:mount.lustre.0 Request processed in 1846us (2114us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.302329:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 84 00000100:00100000:1.0:1789066035.307711:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066035.307885:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015104 00000100:00100000:0.0:1789066035.307900:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015104 00000100:00100000:0.0:1789066035.307977:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:0.0:1789066035.307990:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+9:13751:x1875971236015104:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789066035.308015:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066035.308043:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce055 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066035.308084:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066035.308098:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 10 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066035.308133:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654400, rc 0) 00000100:00100000:0.0:1789066035.308215:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13751:x1875971236015104:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 226us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.308224:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 85 00000100:00100000:0.0:1789066035.312320:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.312480:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015232 00000100:00100000:3.0:1789066035.312493:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015232 00000100:00100000:3.0:1789066035.312609:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:3.0:1789066035.312623:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0607c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13751:x1875971236015232:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789066035.313308:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0607c0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13751:x1875971236015232:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 684us (1000us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.313319:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 86 00000100:00100000:1.0:1789066035.317740:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066035.317902:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015360 00000100:00100000:2.0:1789066035.317916:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015360 00000100:00100000:2.0:1789066035.317991:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:2.0:1789066035.318003:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13751:x1875971236015360:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789066035.318499:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13751:x1875971236015360:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 495us (772us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066035.318509:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 87 00000100:00100000:1.0:1789066035.322683:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066035.323249:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015488 00000100:00100000:0.0:1789066035.323265:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015488 00000100:00100000:0.0:1789066035.323343:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:0.0:1789066035.323355:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13773:x1875971236015488:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789066035.323737:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13773:x1875971236015488:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 382us (1067us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.323746:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 88 00000100:00100000:0.0:1789066035.339537:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.339707:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015616 00000100:00100000:3.0:1789066035.339724:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015616 00000100:00100000:3.0:1789066035.340042:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:3.0:1789066035.340056:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13773:x1875971236015616:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789066035.340403:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13773:x1875971236015616:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 348us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.340413:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 89 00000100:00100000:1.0:1789066035.345428:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.353111:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015744 00000100:00100000:3.0:1789066035.353134:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015744 00000100:00100000:3.0:1789066035.353216:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:3.0:1789066035.353227:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875971236015744:12345-192.168.204.23@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789066035.353268:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from d8884011-f51c-4c21-8191-38ad45143351@192.168.204.23@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1789066035.353353:0:14411:0:(genops.c:1384:class_connect()) connect: client d8884011-f51c-4c21-8191-38ad45143351, cookie 0x7555615576c839ad 00000004:00100000:3.0:1789066035.353398:0:14411:0:(mdt_handler.c:7352:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1789066035.353406:0:14411:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789066035.384320:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3296:1875971258032256:0@lo:400:kworker.0 00000100:00100000:1.0:1789066035.384417:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258032384:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.384424:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066035.384469:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066035.384484:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971258032768:0@lo:400:kworker.0 00000100:00100000:1.0:1789066035.384492:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258032896:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.384511:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066035.384526:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258032640:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.385942:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032768 00000100:00100000:3.0:1789066035.385965:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032768 00000100:00100000:3.0:1789066035.386065:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789066035.386078:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971258032768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.386194:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971258032768:12345-0@lo:400:kworker.0 Request processed in 118us (1681us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.386229:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789066035.386302:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066035.386357:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1789066035.386370:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258032512:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.386421:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066035.386442:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258033024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789066035.386466:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789066035.386497:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789066035.386509:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032896 00000100:00100000:3.0:1789066035.386513:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032896 00000100:00100000:3.0:1789066035.386542:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789066035.386571:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258032896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.386610:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bacb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3297:x1875971258032896:12345-0@lo:400:kworker.0 Request processed in 62us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.386616:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1789066035.386666:0:3296:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70d880 x1875971258032768/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789066035.386685:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971258032768:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.386723:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032384 00000100:00100000:3.0:1789066035.386727:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032384 00000100:00100000:3.0:1789066035.386754:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032512 00000100:00100000:3.0:1789066035.386756:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032512 00000100:00100000:3.0:1789066035.386778:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789066035.386785:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258032384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.386819:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258032384:12345-0@lo:400:kworker.0 Request processed in 35us (2350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.386835:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789066035.386847:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789066035.386853:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258032512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.386894:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258032512:12345-0@lo:400:kworker.0 Request processed in 42us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.386900:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789066035.386919:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033024 00000100:00100000:3.0:1789066035.386923:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033024 00000100:00100000:3.0:1789066035.386950:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789066035.386956:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258033024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789066035.386995:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789066035.387032:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3297:x1875971258033024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.387039:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789066035.387055:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789066035.387058:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789066035.387060:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789066035.387082:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258032512:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.387099:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b26b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258033024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789066035.387111:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258032384:0@lo:400:kworker.0 00010000:00080000:3.0:1789066035.387139:0:3297:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70ca80 x1875971258032896/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789066035.387149:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3297:1875971258032896:0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.387194:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032256 00000100:00100000:3.0:1789066035.387205:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032256 00000100:00100000:3.0:1789066035.387236:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789066035.387243:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3296:x1875971258032256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066035.387281:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3296:x1875971258032256:12345-0@lo:400:kworker.0 Request processed in 39us (2857us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.387287:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789066035.387323:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3296:1875971258032256:0@lo:400:kworker.0 00000100:00100000:1.0:1789066035.395573:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066035.395693:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258032640 00000100:00100000:1.0:1789066035.395706:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258032640 00000100:00100000:1.0:1789066035.395771:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789066035.395783:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258032640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066035.396171:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3295:x1875971258032640:12345-0@lo:400:kworker.0 Request processed in 389us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066035.396181:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1789066035.396242:0:3295:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9cf07f70f480 x1875971258032640/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789066051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789066035.396259:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f70f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3295:1875971258032640:0@lo:400:kworker.0 00000100:00080000:2.0:1789066035.478120:0:14411:0:(import.c:65:import_set_state_nolock()) ffff9cef43100000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789066035.478249:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+6:2346:x1875971236015744:12345-192.168.204.23@tcp:38:mount.lustre.0 Request processed in 125021us (132835us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066035.478263:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:3.0:1789066035.482390:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.482846:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000001:00080000:2.0:1789066035.489327:0:7636:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000100:00100000:0.0:1789066035.489415:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236015872 00000100:00100000:0.0:1789066035.489428:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236015872 00000100:00100000:0.0:1789066035.489520:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016000 00000100:00100000:0.0:1789066035.489524:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016000 00000100:00100000:0.0:1789066035.489577:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:0.0:1789066035.489590:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+7:0:x1875971236015872:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789066035.489644:0:14414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789066035.489773:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+7:0:x1875971236015872:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 185us (7399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.489780:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:0.0:1789066035.489802:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:0.0:1789066035.489809:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+6:13751:x1875971236016000:12345-192.168.204.23@tcp:41:mount.lustre.0 00000100:00080000:2.0:1789066035.489949:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000024:0.0:1789066035.489976:0:14414:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789066035.490005:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+6:13751:x1875971236016000:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 196us (7166us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066035.490012:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000040:00080000:1.0:1789066035.494425:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789066035.496272:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.498392:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016128 00000100:00100000:3.0:1789066035.498418:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016128 00000100:00100000:3.0:1789066035.498593:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1789066035.498609:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+6:13751:x1875971236016128:12345-192.168.204.23@tcp:40:mount.lustre.0 00000100:00100000:3.0:1789066035.498761:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+6:13751:x1875971236016128:12345-192.168.204.23@tcp:40:mount.lustre.0 Request processed in 155us (2505us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.498770:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789066035.502541:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.504458:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016256 00000100:00100000:3.0:1789066035.504482:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016256 00000100:00100000:3.0:1789066035.504589:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:3.0:1789066035.504600:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2346:x1875971236016256:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789066035.504640:0:15097:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from d8884011-f51c-4c21-8191-38ad45143351@192.168.204.23@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:3.0:1789066035.504684:0:15097:0:(genops.c:1384:class_connect()) connect: client d8884011-f51c-4c21-8191-38ad45143351, cookie 0x7555615576c839b4 00002000:00100000:3.0:1789066035.504700:0:15097:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d8884011-f51c-4c21-8191-38ad45143351/ffff9cf0478aa800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789066035.504734:0:15097:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789066035.505352:0:15097:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789066035.505429:0:15097:0:(import.c:65:import_set_state_nolock()) ffff9cf0478ac800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789066035.506351:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:d8884011-f51c-4c21-8191-38ad45143351+6:2346:x1875971236016256:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 1742us (3813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066035.506365:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:2.0:1789066035.506730:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066035.506822:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066035.506967:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016512 00000100:00100000:3.0:1789066035.506978:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016512 00000100:00100000:3.0:1789066035.507042:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1789066035.507052:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+6:13751:x1875971236016512:12345-192.168.204.23@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789066035.508173:0:14415:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1036us 00000100:00100000:1.0:1789066035.508768:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016384 00000100:00100000:1.0:1789066035.508785:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016384 00000100:00100000:1.0:1789066035.508911:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1789066035.508922:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2346:x1875971236016384:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789066035.508978:0:15532:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from d8884011-f51c-4c21-8191-38ad45143351@192.168.204.23@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1789066035.509028:0:15532:0:(genops.c:1384:class_connect()) connect: client d8884011-f51c-4c21-8191-38ad45143351, cookie 0x7555615576c839bb 00002000:00100000:1.0:1789066035.509688:0:15532:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d8884011-f51c-4c21-8191-38ad45143351/ffff9cef42eab800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789066035.509720:0:15532:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789066035.510391:0:15532:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789066035.510445:0:15532:0:(import.c:65:import_set_state_nolock()) ffff9cef42eaa000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789066035.510594:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+6:2346:x1875971236016384:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 1667us (3860us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066035.510606:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000004:00200000:2.0:1789066035.542753:0:14415:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789066035.542890:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+6:13751:x1875971236016512:12345-192.168.204.23@tcp:33:mount.lustre.0 Request processed in 35825us (36054us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066035.542904:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:0.0:1789066035.786782:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066035.787033:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016640 00000100:00100000:2.0:1789066035.787047:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016640 00000100:00100000:2.0:1789066035.787125:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:2.0:1789066035.787136:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+6:13794:x1875971236016640:12345-192.168.204.23@tcp:101:mkdir.0 00010000:00010000:2.0:1789066035.787162:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066035.787193:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c839c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce07f expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.787285:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c839c9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.787301:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c839c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.787318:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c839c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066035.787381:0:14411:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789066035.787386:0:14411:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066035.787429:0:14411:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c839c9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.787456:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d200/0x7555615576c839c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce07f expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.787477:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c839c9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce07f expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066035.787486:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:2.0:1789066035.787490:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789066035.787494:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789066035.787627:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+7:13794:x1875971236016640:12345-192.168.204.23@tcp:101:mkdir.0 Request processed in 492us (860us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066035.787633:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:1.0:1789066036.071509:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066037.093763:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789066037.930680:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bacbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258033152:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789066037.930842:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066037.931140:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033152 00000100:00100000:3.0:1789066037.931149:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033152 00000100:00100000:3.0:1789066037.931219:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789066037.931230:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258033152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789066037.931268:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789066037.931316:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258033152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066037.931323:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1789066037.933667:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789066037.933747:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bacbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258033152:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789066038.011600:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.011778:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016768 00000100:00100000:0.0:1789066038.011788:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016768 00000100:00100000:0.0:1789066038.011885:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:0.0:1789066038.011897:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+7:13846:x1875971236016768:12345-192.168.204.23@tcp:41:lfs.0 00000004:00000024:0.0:1789066038.011943:0:14413:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789066038.012102:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+7:13846:x1875971236016768:12345-192.168.204.23@tcp:41:lfs.0 Request processed in 207us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.012110:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00080000:1.0:1789066038.012854:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789066038.018491:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.018656:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236016896 00000100:00100000:0.0:1789066038.018670:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236016896 00000100:00100000:0.0:1789066038.018776:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789066038.018789:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8884011-f51c-4c21-8191-38ad45143351+6:13846:x1875971236016896:12345-192.168.204.23@tcp:13:lfs.0 00000100:00080000:1.0:1789066038.019090:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:0.0:1789066038.019272:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789066038.019392:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8884011-f51c-4c21-8191-38ad45143351+6:13846:x1875971236016896:12345-192.168.204.23@tcp:13:lfs.0 Request processed in 600us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.019403:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789066038.024044:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.024406:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017024 00000100:00100000:3.0:1789066038.024417:0:15100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017024 00000100:00100000:3.0:1789066038.024497:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1789066038.024509:0:15100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8884011-f51c-4c21-8191-38ad45143351+6:13846:x1875971236017024:12345-192.168.204.23@tcp:13:lfs.0 00002000:00000024:3.0:1789066038.024584:0:15100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1789066038.025082:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789066038.025760:0:15100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:d8884011-f51c-4c21-8191-38ad45143351+6:13846:x1875971236017024:12345-192.168.204.23@tcp:13:lfs.0 Request processed in 1246us (1721us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.025772:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:1.0:1789066038.121277:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066038.242131:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.242235:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017152 00000100:00100000:0.0:1789066038.242258:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017152 00000100:00100000:0.0:1789066038.242314:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:0.0:1789066038.242325:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+10:13878:x1875971236017152:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789066038.242342:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066038.242361:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081655a00/0x7555615576c839d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce086 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.242390:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081655a00/0x7555615576c839d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce086 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.242402:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081655a00/0x7555615576c839d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce086 expref: 11 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.242412:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655a00, rc 0) 00000100:00100000:0.0:1789066038.242646:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13878:x1875971236017152:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 321us (524us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.242654:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 91 00000100:00100000:1.0:1789066038.255385:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.255534:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017280 00000100:00100000:3.0:1789066038.255545:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017280 00000100:00100000:3.0:1789066038.255639:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:3.0:1789066038.255649:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13878:x1875971236017280:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789066038.256364:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13878:x1875971236017280:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 713us (988us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.256374:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 92 00000100:00100000:1.0:1789066038.262181:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.262289:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017408 00000100:00100000:0.0:1789066038.262300:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017408 00000100:00100000:0.0:1789066038.262363:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:0.0:1789066038.262375:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13878:x1875971236017408:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789066038.262889:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13878:x1875971236017408:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 514us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.262900:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 93 00000100:00100000:0.0:1789066038.275638:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066038.277273:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017536 00000100:00100000:2.0:1789066038.277287:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017536 00000100:00100000:2.0:1789066038.277418:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:2.0:1789066038.277430:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13885:x1875971236017536:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789066038.277860:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13885:x1875971236017536:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 432us (2234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066038.277870:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 94 00000100:00100000:1.0:1789066038.301481:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.301582:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017664 00000100:00100000:0.0:1789066038.301601:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017664 00000100:00100000:0.0:1789066038.301703:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:0.0:1789066038.301714:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13885:x1875971236017664:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789066038.302083:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13885:x1875971236017664:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 370us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.302092:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 95 00000100:00100000:1.0:1789066038.307170:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066038.307391:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017792 00000100:00100000:2.0:1789066038.307402:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017792 00000100:00100000:2.0:1789066038.307477:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:2.0:1789066038.307487:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13878:x1875971236017792:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789066038.307505:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066038.307524:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf07fd1d200/0x7555615576c839d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce0b0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066038.307584:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf07fd1d200/0x7555615576c839d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b0 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066038.307597:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf07fd1d200/0x7555615576c839d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b0 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066038.307606:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d200, rc 0) 00000100:00100000:2.0:1789066038.307668:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d64050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13878:x1875971236017792:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 182us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066038.307676:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 96 00000100:00100000:1.0:1789066038.311187:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.311492:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236017920 00000100:00100000:3.0:1789066038.311504:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236017920 00000100:00100000:3.0:1789066038.311612:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:3.0:1789066038.311624:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13878:x1875971236017920:12345-192.168.204.23@tcp:256:mount.lustre.0 20000000:01000000:3.0:1789066038.311653:0:14406:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789066038.311680:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789066038.311684:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789066038.311687:0:14406:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789066038.311690:0:14406:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789066038.313376:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13878:x1875971236017920:12345-192.168.204.23@tcp:256:mount.lustre.0 Request processed in 1746us (2191us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.313390:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 97 00000100:00100000:1.0:1789066038.316739:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.316931:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018048 00000100:00100000:0.0:1789066038.316947:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018048 00000100:00100000:0.0:1789066038.317018:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:0.0:1789066038.317037:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13878:x1875971236018048:12345-192.168.204.23@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789066038.317067:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066038.317103:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce0b7 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.317152:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.317173:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.317191:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655200, rc 0) 00000100:00100000:0.0:1789066038.317302:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d67c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13878:x1875971236018048:12345-192.168.204.23@tcp:101:mount.lustre.0 Request processed in 265us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.317313:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 98 00000100:00100000:0.0:1789066038.322892:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.322994:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018176 00000100:00100000:3.0:1789066038.323006:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018176 00000100:00100000:3.0:1789066038.323067:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1789066038.323077:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13878:x1875971236018176:12345-192.168.204.23@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789066038.323405:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d65c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13878:x1875971236018176:12345-192.168.204.23@tcp:501:mount.lustre.0 Request processed in 328us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.323424:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 99 00000100:00100000:3.0:1789066038.333214:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066038.333322:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018304 00000100:00100000:2.0:1789066038.333334:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018304 00000100:00100000:2.0:1789066038.333393:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:2.0:1789066038.333403:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13878:x1875971236018304:12345-192.168.204.23@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789066038.334911:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13878:x1875971236018304:12345-192.168.204.23@tcp:503:mount.lustre.0 Request processed in 1501us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066038.334926:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 100 00000100:00100000:1.0:1789066038.341695:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.341903:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018432 00000100:00100000:0.0:1789066038.341915:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018432 00000100:00100000:0.0:1789066038.341974:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:0.0:1789066038.341985:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13889:x1875971236018432:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789066038.342448:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13889:x1875971236018432:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 462us (760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.342457:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 101 00000100:00100000:0.0:1789066038.349991:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.350331:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018560 00000100:00100000:3.0:1789066038.350341:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018560 00000100:00100000:3.0:1789066038.350402:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:3.0:1789066038.350412:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13889:x1875971236018560:12345-192.168.204.23@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789066038.350707:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d66850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13889:x1875971236018560:12345-192.168.204.23@tcp:502:llog_process_th.0 Request processed in 296us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.350715:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 102 00000100:00100000:2.0:1789066038.370456:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.370771:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018688 00000100:00100000:0.0:1789066038.370784:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018688 00000100:00100000:0.0:1789066038.370864:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1789066038.370874:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2346:x1875971236018688:12345-192.168.204.23@tcp:38:mount.lustre.0 00010000:00080000:0.0:1789066038.370916:0:14411:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 195e55f3-2761-4c99-af1d-7ca8a37e0a8b@192.168.204.23@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1789066038.370971:0:14411:0:(genops.c:1384:class_connect()) connect: client 195e55f3-2761-4c99-af1d-7ca8a37e0a8b, cookie 0x7555615576c839e5 00000004:00100000:0.0:1789066038.371013:0:14411:0:(mdt_handler.c:7352:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1789066038.371162:0:14411:0:(import.c:65:import_set_state_nolock()) ffff9cf07ec24800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789066038.371239:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2346:x1875971236018688:12345-192.168.204.23@tcp:38:mount.lustre.0 Request processed in 365us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.371248:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:0.0:1789066038.375069:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066038.375114:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.375993:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019328 00000100:00100000:3.0:1789066038.376005:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019328 00000100:00100000:3.0:1789066038.376078:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1789066038.376090:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236019328:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066038.376182:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236019328:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 94us (1066us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.376190:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1789066038.376263:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019072 00000100:00100000:1.0:1789066038.376268:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019072 00000100:00100000:1.0:1789066038.376307:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1789066038.376313:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+7:2347:x1875971236019072:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066038.376345:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+7:2347:x1875971236019072:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 32us (1286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066038.376366:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:2.0:1789066038.381669:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.381702:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019200 00000100:00100000:3.0:1789066038.381721:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019200 00000100:00100000:3.0:1789066038.381781:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:3.0:1789066038.381792:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8884011-f51c-4c21-8191-38ad45143351+6:2348:x1875971236019200:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066038.381888:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8884011-f51c-4c21-8191-38ad45143351+6:2348:x1875971236019200:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 98us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066038.381896:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1789066038.383492:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066038.383533:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066038.383656:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018944 00000100:00100000:1.0:1789066038.383664:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018944 00000100:00100000:1.0:1789066038.383747:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236018816 00000100:00100000:1.0:1789066038.383751:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236018816 00000100:00100000:1.0:1789066038.383778:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1789066038.383787:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+7:13878:x1875971236018944:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789066038.383815:0:15531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789066038.383892:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+7:13878:x1875971236018944:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 105us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066038.383899:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1789066038.383917:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789066038.383923:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:0:x1875971236018816:12345-192.168.204.23@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789066038.383933:0:15531:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789066038.383956:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:0:x1875971236018816:12345-192.168.204.23@tcp:41:mount.lustre.0 Request processed in 34us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066038.383963:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00080000:2.0:1789066038.384145:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789066038.397615:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066038.397812:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019456 00000100:00100000:1.0:1789066038.397832:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019456 00000100:00100000:1.0:1789066038.397901:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1789066038.397912:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:13878:x1875971236019456:12345-192.168.204.23@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789066038.398001:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:13878:x1875971236019456:12345-192.168.204.23@tcp:40:mount.lustre.0 Request processed in 91us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066038.398009:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:1.0:1789066038.417077:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066038.417129:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066038.417168:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.417240:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019584 00000100:00100000:3.0:1789066038.417260:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019584 00000100:00100000:2.0:1789066038.417266:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019712 00000100:00100000:2.0:1789066038.417271:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019712 00000100:00100000:0.0:1789066038.417342:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019840 00000100:00100000:0.0:1789066038.417346:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019840 00000100:00100000:0.0:1789066038.417386:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1789066038.417395:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:13878:x1875971236019840:12345-192.168.204.23@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789066038.417468:0:14416:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789066038.417538:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:13878:x1875971236019840:12345-192.168.204.23@tcp:33:mount.lustre.0 Request processed in 144us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.417586:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1789066038.417845:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1789066038.417851:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b26bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875971236019584:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789066038.417873:0:15095:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 195e55f3-2761-4c99-af1d-7ca8a37e0a8b@192.168.204.23@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1789066038.417905:0:15095:0:(genops.c:1384:class_connect()) connect: client 195e55f3-2761-4c99-af1d-7ca8a37e0a8b, cookie 0x7555615576c839ec 00002000:00100000:0.0:1789066038.417915:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 195e55f3-2761-4c99-af1d-7ca8a37e0a8b/ffff9cf07f308000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789066038.417926:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789066038.418027:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789066038.418054:0:15095:0:(import.c:65:import_set_state_nolock()) ffff9cf074ec4800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789066038.418094:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b26bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2346:x1875971236019584:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 241us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.418101:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:0.0:1789066038.418115:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:0.0:1789066038.418119:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2346:x1875971236019712:12345-192.168.204.23@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789066038.418133:0:15095:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 195e55f3-2761-4c99-af1d-7ca8a37e0a8b@192.168.204.23@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1789066038.418150:0:15095:0:(genops.c:1384:class_connect()) connect: client 195e55f3-2761-4c99-af1d-7ca8a37e0a8b, cookie 0x7555615576c839f3 00002000:00100000:0.0:1789066038.418155:0:15095:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 195e55f3-2761-4c99-af1d-7ca8a37e0a8b/ffff9cf074ec6000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a28 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789066038.418161:0:15095:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789066038.418209:0:15095:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789066038.418240:0:15095:0:(import.c:65:import_set_state_nolock()) ffff9cf074825800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789066038.418264:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2346:x1875971236019712:12345-192.168.204.23@tcp:8:mount.lustre.0 Request processed in 143us (1095us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.418270:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:1.0:1789066038.664174:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066038.664287:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236019968 00000100:00100000:3.0:1789066038.664302:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236019968 00000100:00100000:0.0:1789066038.664478:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:0.0:1789066038.664493:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:13910:x1875971236019968:12345-192.168.204.23@tcp:101:mkdir.0 00010000:00010000:0.0:1789066038.664519:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066038.664604:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c839fa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce0e1 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.664691:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.664708:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.664733:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789066038.664795:0:14411:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789066038.664799:0:14411:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789066038.664833:0:14411:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.664864:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655000/0x7555615576c839fa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.664884:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066038.664894:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:0.0:1789066038.664897:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789066038.664902:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654a00, rc 0) 00000100:00100000:0.0:1789066038.665264:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+7:13910:x1875971236019968:12345-192.168.204.23@tcp:101:mkdir.0 Request processed in 772us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066038.665293:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000001:00100000:3.0:1789066039.088372:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 195e55f3-2761-4c99-af1d-7ca8a37e0a8b 00000001:00100000:3.0:1789066039.089535:0:6711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d8884011-f51c-4c21-8191-38ad45143351 00010000:00010000:0.0:1789066039.141887:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066040.165890:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789066040.486929:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789066040.486968:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258033280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789066040.487049:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066040.487125:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033280 00000100:00100000:1.0:1789066040.487134:0:15100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033280 00000100:00100000:1.0:1789066040.487196:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789066040.487205:0:15100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258033280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789066040.487244:0:15100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789066040.487292:0:15100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258033280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066040.487299:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789066040.487321:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789066040.487348:0:3295:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1789066040.487370:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc94700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258033280:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789066040.490883:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258033536:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.490999:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066040.491038:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789066040.491044:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3298:1875971258033408:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491090:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066040.491117:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258033920:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491162:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066040.491192:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033536 00000100:00100000:0.0:1789066040.491201:0:15097:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033536 00000100:00100000:0.0:1789066040.491254:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789066040.491265:0:15097:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258033536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491319:0:15097:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258033536:12345-0@lo:400:kworker.0 Request processed in 55us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066040.491326:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789066040.491350:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033408 00000100:00100000:0.0:1789066040.491354:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033408 00000100:00100000:0.0:1789066040.491376:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789066040.491381:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3298:x1875971258033408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491406:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3298:x1875971258033408:12345-0@lo:400:kworker.0 Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066040.491411:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789066040.491448:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033920 00000100:00100000:0.0:1789066040.491451:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033920 00000100:00100000:0.0:1789066040.491476:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789066040.491491:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258033920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491522:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3298:x1875971258033920:12345-0@lo:400:kworker.0 Request processed in 33us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066040.491529:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1789066040.491568:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789066040.491573:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789066040.491584:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971258033792:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491609:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066040.491627:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789066040.491633:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971258033664:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491668:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066040.491693:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033792 00000100:00100000:0.0:1789066040.491696:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033792 00000100:00100000:0.0:1789066040.491721:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258033664 00000100:00100000:0.0:1789066040.491724:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258033664 00000100:00100000:0.0:1789066040.491737:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789066040.491742:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971258033792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491774:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3296:x1875971258033792:12345-0@lo:400:kworker.0 Request processed in 31us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066040.491790:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789066040.491803:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789066040.491809:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971258033664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491837:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3296:x1875971258033664:12345-0@lo:400:kworker.0 Request processed in 29us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066040.491842:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1789066040.491856:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789066040.491886:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3296:1875971258033664:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491907:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3296:1875971258033792:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491944:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3298:1875971258033408:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491954:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3298:1875971258033920:0@lo:400:kworker.0 00000100:00100000:0.0:1789066040.491963:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258033536:0@lo:400:kworker.0 00000001:00100000:1.0:1789066040.537831:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 195e55f3-2761-4c99-af1d-7ca8a37e0a8b 00000001:00100000:1.0:1789066040.537848:0:7636:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d8884011-f51c-4c21-8191-38ad45143351 00000001:00100000:2.0:1789066040.546435:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 195e55f3-2761-4c99-af1d-7ca8a37e0a8b 00000001:00100000:2.0:1789066040.546455:0:5860:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d8884011-f51c-4c21-8191-38ad45143351 00010000:00010000:1.0:1789066041.193948:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789066041.985056:0:16377:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789066042.219731:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066043.061589:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258034048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789066043.061710:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066043.061841:0:15100:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034048 00000100:00100000:3.0:1789066043.061852:0:15100:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034048 00000100:00100000:3.0:1789066043.061929:0:15100:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789066043.061941:0:15100:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258034048:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789066043.062368:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:3.0:1789066043.066000:0:15100:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789066043.066161:0:15100:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bacaa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258034048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4216us (4458us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066043.066176:0:15100:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789066043.066287:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bacb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258034048:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789066043.238802:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066043.814380:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066043.815995:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020224 00000100:00100000:0.0:1789066043.816014:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020224 00000100:00100000:0.0:1789066043.816118:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:0.0:1789066043.816135:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236020224:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:0.0:1789066043.816256:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bacb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236020224:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 127us (1898us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066043.816264:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00080000:3.0:1789066043.816794:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789066043.824221:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066043.824279:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066043.824301:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066043.824329:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066043.824352:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066043.824379:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066043.824414:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020480 00000100:00100000:1.0:1789066043.824436:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020480 00000100:00100000:1.0:1789066043.824503:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020352 00000100:00100000:1.0:1789066043.824506:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020352 00000100:00100000:1.0:1789066043.824522:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020864 00000100:00100000:1.0:1789066043.824524:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020864 00000100:00100000:1.0:1789066043.824541:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020736 00000100:00100000:1.0:1789066043.824543:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020736 00000100:00100000:1.0:1789066043.824591:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1789066043.824602:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236020480:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066043.824701:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236020480:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 100us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066043.824709:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:1.0:1789066043.824739:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1789066043.824746:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2348:x1875971236020352:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066043.824773:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2348:x1875971236020352:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 28us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066043.824779:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1789066043.824789:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1789066043.824795:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2348:x1875971236020864:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066043.824816:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2348:x1875971236020864:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 22us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066043.824822:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1789066043.824832:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1789066043.824837:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236020736:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066043.824856:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236020736:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 20us (477us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066043.824869:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:1.0:1789066043.824891:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020608 00000100:00100000:1.0:1789066043.824894:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020608 00000100:00100000:1.0:1789066043.824928:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:1.0:1789066043.824935:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2348:x1875971236020608:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066043.824966:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2348:x1875971236020608:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 32us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066043.824973:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00080000:1.0:1789066043.825000:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789066043.825005:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789066043.825008:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789066043.825418:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020096 00000100:00100000:2.0:1789066043.825425:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020096 00000100:00100000:2.0:1789066043.825474:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 104 00000100:00100000:2.0:1789066043.825483:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:2348:x1875971236020096:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:2.0:1789066043.825530:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:2348:x1875971236020096:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (1249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066043.825537:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 104 00010000:00010000:2.0:1789066044.262780:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066045.287253:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066045.606405:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258034176:0@lo:400:kworker.0 00000100:00100000:3.0:1789066045.606499:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066045.606621:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07baca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258034304:0@lo:400:kworker.0 00000100:00100000:3.0:1789066045.606671:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066045.606733:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034304 00000100:00100000:3.0:1789066045.606741:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034304 00000100:00100000:3.0:1789066045.606797:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789066045.606806:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258034304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066045.606894:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034176 00000100:00100000:0.0:1789066045.606899:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034176 00000100:00100000:0.0:1789066045.606994:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789066045.607004:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258034176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066045.607043:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258034176:12345-0@lo:400:kworker.0 Request processed in 41us (544us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066045.607044:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258034304:12345-0@lo:400:kworker.0 Request processed in 240us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066045.607051:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789066045.607051:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:3.0:1789066045.607072:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789066045.607105:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07baca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258034304:0@lo:400:kworker.0 00000100:00100000:3.0:1789066045.607208:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258034176:0@lo:400:kworker.0 00000100:00100000:3.0:1789066045.607250:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258034432:0@lo:400:kworker.0 00000100:00100000:3.0:1789066045.607275:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066045.607309:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034432 00000100:00100000:3.0:1789066045.607313:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034432 00000100:00100000:3.0:1789066045.607343:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789066045.607349:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07baca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258034432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066045.607384:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07baca680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258034432:12345-0@lo:400:kworker.0 Request processed in 34us (108us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066045.607390:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789066045.607396:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bac8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258034432:0@lo:400:kworker.0 00000100:00080000:3.0:1789066045.607403:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789066045.608479:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258034560:0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.608533:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066045.608692:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034560 00000100:00100000:1.0:1789066045.608699:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034560 00000100:00100000:1.0:1789066045.608743:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789066045.608752:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258034560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.608955:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258034560:12345-0@lo:400:kworker.0 Request processed in 204us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066045.608963:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789066045.609013:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258034560:0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.609056:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258034688:0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.609082:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066045.609117:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034688 00000100:00100000:1.0:1789066045.609121:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034688 00000100:00100000:1.0:1789066045.609161:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789066045.609167:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258034688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.609202:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3295:x1875971258034688:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066045.609208:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789066045.609238:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3295:1875971258034688:0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.609268:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258034816:0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.609289:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066045.609311:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034816 00000100:00100000:1.0:1789066045.609315:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034816 00000100:00100000:1.0:1789066045.609334:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789066045.609399:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971258034816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066045.609433:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971258034816:12345-0@lo:400:kworker.0 Request processed in 92us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066045.609439:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789066045.609465:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258034816:0@lo:400:kworker.0 00000100:00080000:3.0:1789066045.610320:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789066045.610961:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789066045.610986:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258034944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789066045.611039:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066045.611080:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258034944 00000100:00100000:2.0:1789066045.611086:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258034944 00000100:00100000:2.0:1789066045.611121:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789066045.611128:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258034944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789066045.611158:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789066045.611194:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258034944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (155us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066045.611200:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789066045.611266:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258034944:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789066045.736567:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789066046.310601:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789066046.527365:0:16527:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd05d31180 20000000:00000080:2.0:1789066046.527383:0:16527:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9cf04789c400 uarg=0000000000000000 20000000:01000000:2.0:1789066046.527419:0:16527:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789066046.527425:0:16527:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789066046.527429:0:16527:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789066046.534417:0:16528:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:1.0:1789066046.534679:0:16527:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1789066046.554498:0:16527:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789066046.555157:0:16527:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555177:0:16527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c836f8 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555185:0:16527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83745 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555193:0:16527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83879 expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555216:0:16527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555224:0:16527:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555230:0:16527:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555275:0:16527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555291:0:16527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 12 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.555306:0:16527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bac9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035072:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789066046.555417:0:16527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 12 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555425:0:16527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 12 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.555433:0:16527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bac9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035200:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789066046.555459:0:16527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c83879 expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555466:0:16527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c83879 expref: 18 pid: 14406 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.555486:0:16527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bacad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035328:0@lo:104: 00000100:00100000:3.0:1789066046.555520:0:16527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789066046.555568:0:16527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c83745 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555576:0:16527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c83745 expref: 18 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.555583:0:16527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bacb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035456:0@lo:104: 00000100:00100000:3.0:1789066046.555601:0:16527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789066046.555619:0:16527:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x7555615576c836f8 expref: 18 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066046.555627:0:16527:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x7555615576c836f8 expref: 18 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.555648:0:16527:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bacbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035584:0@lo:104: 00000100:00100000:3.0:1789066046.555677:0:16527:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066046.555687:0:16527:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050e53900 going to sleep for 11 seconds 00000100:00100000:0.0:1789066046.555721:0:14396:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1789066046.555735:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258035328 00000100:00100000:0.0:1789066046.555742:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258035328 00000100:00100000:0.0:1789066046.555778:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258035456 00000100:00100000:0.0:1789066046.555789:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258035456 00000100:00100000:0.0:1789066046.555803:0:14396:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258035584 00000100:00100000:0.0:1789066046.555805:0:14396:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258035584 00000100:00100000:0.0:1789066046.555817:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789066046.555825:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07baca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+5:16527:x1875971258035328:12345-0@lo:104: 00010000:00010000:0.0:1789066046.555839:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.555912:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789066046.555918:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07baca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+5:16527:x1875971258035328:12345-0@lo:104: Request processed in 94us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.555924:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789066046.555941:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789066046.555947:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+4:16527:x1875971258035456:12345-0@lo:104: 00010000:00010000:0.0:1789066046.555954:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.555985:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789066046.555990:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+4:16527:x1875971258035456:12345-0@lo:104: Request processed in 44us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.555996:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789066046.556007:0:14396:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789066046.556013:0:14396:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07ad2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:16527:x1875971258035584:12345-0@lo:104: 00010000:00010000:0.0:1789066046.556019:0:14396:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556044:0:14396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789066046.556050:0:14396:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07ad2b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+3:16527:x1875971258035584:12345-0@lo:104: Request processed in 37us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.556062:0:14396:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789066046.556101:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789066046.556107:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556114:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d600 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789066046.556118:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556126:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789066046.556133:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066046.556139:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789066046.556167:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556173:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789066046.556192:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556198:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1d600/0x7555615576c83879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c83880 expref: -99 pid: 15814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556210:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789066046.556213:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556244:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789066046.556248:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556254:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789066046.556260:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066046.556264:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789066046.556280:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556285:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789066046.556299:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556305:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf07fd1dc00/0x7555615576c83745 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c8374c expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556313:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066046.556315:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556321:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7200 already unused, calling callback (ffffffffc1b4dc20) 10000000:00010000:0.0:1789066046.556323:0:14401:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556340:0:14401:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789066046.556346:0:14401:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789066046.556351:0:14401:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789066046.556369:0:14401:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556374:0:14401:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789066046.556380:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556386:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7200/0x7555615576c836f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x7555615576c836ff expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556398:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066046.556400:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066046.556401:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066046.556407:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789066046.556426:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3298:1875971258035712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066046.556456:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066046.556496:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258035840:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066046.556517:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066046.556534:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789066046.556539:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258035968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066046.556584:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066046.556619:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258035712 00000100:00100000:0.0:1789066046.556623:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258035712 00010000:00010000:0.0:1789066046.556642:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c83879 expref: 19 pid: 14406 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066046.556655:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258035840 00000100:00100000:0.0:1789066046.556658:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258035840 00010000:00010000:0.0:1789066046.556678:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c83745 expref: 20 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066046.556689:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258035968 00000100:00100000:0.0:1789066046.556692:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258035968 00010000:00010000:0.0:1789066046.556701:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c836f8 expref: 21 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066046.556713:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789066046.556719:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+21:3298:x1875971258035712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789066046.556730:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066046.556736:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c83879 expref: 21 pid: 14406 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556745:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c83879 expref: 21 pid: 14406 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556758:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066046.556786:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+21:3298:x1875971258035712:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.556791:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789066046.556805:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789066046.556810:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+20:3295:x1875971258035840:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789066046.556825:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066046.556830:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c83745 expref: 20 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556837:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c83745 expref: 20 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556846:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066046.556872:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+20:3295:x1875971258035840:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (353us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.556877:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789066046.556889:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789066046.556895:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258035968:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789066046.556902:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066046.556906:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x7555615576c836f8 expref: 19 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556913:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x7555615576c836f8 expref: 19 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.556921:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066046.556941:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07a97e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258035968:12345-0@lo:103:ldlm_bl.0 Request processed in 46us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.556947:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789066046.557005:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3298:1875971258035712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066046.557028:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258035968:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789066046.557034:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258035840:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789066046.557314:0:16527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07b049600/0x7555615576c83880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c83879 expref: 18 pid: 14406 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.557325:0:16527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bacad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035328:0@lo:104: 00010000:00010000:3.0:1789066046.557335:0:16527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf07b049000/0x7555615576c8374c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c83745 expref: 17 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.557342:0:16527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bacb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035456:0@lo:104: 00010000:00010000:3.0:1789066046.557356:0:16527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf081654600/0x7555615576c836ff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x7555615576c836f8 expref: 16 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066046.557371:0:16527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bacbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035584:0@lo:104: 00000100:00100000:0.0:1789066046.576721:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066046.576759:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066046.576804:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021120 00000100:00100000:0.0:1789066046.576813:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021120 00000100:00100000:1.0:1789066046.576853:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236020992 00000100:00100000:1.0:1789066046.576857:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236020992 00010000:00010000:1.0:1789066046.576879:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 14 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066046.576917:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1789066046.576927:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+14:2348:x1875971236020992:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789066046.576945:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789066046.576964:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 14 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.576975:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 13 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066046.576977:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 14 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066046.576993:0:14398:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:1.0:1789066046.576999:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066046.577001:0:14398:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789066046.577127:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+14:2348:x1875971236020992:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 200us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.577132:0:14397:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789066046.577135:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789066046.577140:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1789066046.577146:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:2348:x1875971236021120:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789066046.577155:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066046.577160:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 13 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577170:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 13 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577187:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577195:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577208:0:14397:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577215:0:14397:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577242:0:14397:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577250:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577256:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066046.577260:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577269:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577279:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066046.577288:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066046.577308:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:2348:x1875971236021120:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 162us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066046.577315:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00010000:00010000:2.0:1789066046.577631:0:16527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf081655200/0x7555615576c839de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0b7 expref: 12 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066046.577646:0:16527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bac9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035072:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789066046.577658:0:16527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf081654400/0x7555615576c839a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce055 expref: 11 pid: 14405 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066046.577677:0:16527:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bac9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16527:1875971258035200:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789066046.577710:0:16527:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066046.577719:0:16527:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066046.577724:0:16527:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066046.577730:0:16527:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9cf040031800/0x7555615576c83a08 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16527 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066047.336305:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789066047.654305:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789066047.654313:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07b234800 from 10 10000000:01000000:0.0:1789066047.654318:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789066047.654370:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066047.654382:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066047.654392:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066047.654434:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789066047.654502:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066047.654602:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f561540 going to sleep for 11 seconds 00000100:00100000:1.0:1789066047.656264:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036096 00000100:00100000:1.0:1789066047.656286:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036096 00000100:00100000:1.0:1789066047.656375:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789066047.656387:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+16:14409:x1875971258036096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789066047.656411:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789066047.656437:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a6400/0x7555615576c83a16 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83a0f expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.656475:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a6400/0x7555615576c83a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83a0f expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.656490:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a6400/0x7555615576c83a16 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83a0f expref: 17 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.656501:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6400, rc 0) 00000100:00100000:1.0:1789066047.656621:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:14409:x1875971258036096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 235us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066047.656630:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789066047.656699:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789066047.656744:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a16 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066047.656758:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83a16 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066047.656850:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789066047.656916:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066047.656959:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f561540 going to sleep for 11 seconds 00000100:00100000:2.0:1789066047.657430:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036224 00000100:00100000:2.0:1789066047.657440:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036224 00000100:00100000:2.0:1789066047.657488:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789066047.657497:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:14409:x1875971258036224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789066047.657943:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:14409:x1875971258036224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 446us (1025us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066047.657951:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789066047.658441:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.658887:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.658965:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066047.659070:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1b780 going to sleep for 11 seconds 00000100:00100000:0.0:1789066047.661957:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036352 00000100:00100000:0.0:1789066047.661983:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036352 00000100:00100000:0.0:1789066047.662064:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789066047.662075:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:14409:x1875971258036352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789066047.662970:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:14409:x1875971258036352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 893us (4002us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066047.662985:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789066047.672184:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036352:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789066047.675491:0:16552:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789066047.677925:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789066047.677981:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789066047.677997:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a16 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066047.678013:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf081655c00/0x7555615576c83a0f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a16 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789066047.678029:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789066047.678095:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf050a10800 from 10 10000000:01000000:3.0:1789066047.678100:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789066047.678160:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066047.678172:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066047.678186:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066047.678306:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036480:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789066047.679169:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066047.679315:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050e53780 going to sleep for 11 seconds 00000100:00100000:1.0:1789066047.682520:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036480 00000100:00100000:1.0:1789066047.682538:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036480 00000100:00100000:1.0:1789066047.682631:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789066047.682655:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+17:14409:x1875971258036480:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789066047.682675:0:14406:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789066047.682699:0:14406:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a6600/0x7555615576c83a24 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83a1d expref: -99 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.682732:0:14406:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a6600/0x7555615576c83a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83a1d expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.682745:0:14406:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a6600/0x7555615576c83a24 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83a1d expref: 18 pid: 14406 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.682754:0:14406:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6600, rc 0) 00000100:00100000:1.0:1789066047.682843:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258036480:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 201us (3676us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066047.682850:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789066047.682912:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bac9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036480:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789066047.682933:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a24 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.682964:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83a24 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066047.683042:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.683085:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066047.683157:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1ba80 going to sleep for 11 seconds 00000100:00100000:2.0:1789066047.683160:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036608 00000100:00100000:2.0:1789066047.683177:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036608 00000100:00100000:2.0:1789066047.683252:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789066047.683262:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258036608:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789066047.684140:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258036608:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 876us (1051us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066047.684154:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789066047.684326:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036608:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789066047.684394:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07bac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036736:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789066047.684454:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789066047.684505:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf050e53780 going to sleep for 11 seconds 00000100:00100000:1.0:1789066047.684619:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036736 00000100:00100000:1.0:1789066047.684630:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036736 00000100:00100000:1.0:1789066047.684820:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789066047.684831:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258036736:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.685059:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258036736:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 229us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066047.685066:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789066047.685155:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07bac9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036736:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789066047.689511:0:16553:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789066047.693512:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789066047.693827:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789066047.693844:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a24 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.693861:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf040031600/0x7555615576c83a1d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a24 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789066047.693876:0:14409:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789066047.693879:0:14409:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9cf07f2f7000 from 10 10000000:01000000:1.0:1789066047.693883:0:14409:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789066047.693944:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.693954:0:14409:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.693992:0:14409:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066047.694028:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.694133:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066047.694212:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036864 00000100:00100000:1.0:1789066047.694221:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036864 00000100:00100000:1.0:1789066047.694281:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789066047.694293:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+18:14409:x1875971258036864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789066047.694311:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789066047.694328:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf0817a7a00/0x7555615576c83a32 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x7555615576c83a2b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.694360:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf0817a7a00/0x7555615576c83a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x7555615576c83a2b expref: 19 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.695086:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf0817a7a00/0x7555615576c83a32 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x7555615576c83a2b expref: 19 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.695099:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7a00, rc 0) 00000100:00100000:1.0:1789066047.695171:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258036864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 880us (1040us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066047.695180:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789066047.695248:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789066047.695276:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789066047.695298:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a32 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.695324:0:14409:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x7555615576c83a32 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066047.695422:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.695452:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066047.695484:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1bc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789066047.696430:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258036992 00000100:00100000:2.0:1789066047.696443:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258036992 00000100:00100000:2.0:1789066047.696505:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789066047.696529:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258036992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789066047.697278:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258036992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 760us (1822us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066047.697289:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789066047.698731:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258036992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789066047.698823:0:14409:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258037120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789066047.698917:0:14409:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066047.698975:0:14409:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07f561b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789066047.698983:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037120 00000100:00100000:1.0:1789066047.698993:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037120 00000100:00100000:1.0:1789066047.699064:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1789066047.699074:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258037120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789066047.699329:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:14409:x1875971258037120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 255us (412us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066047.699339:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1789066047.699762:0:14409:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:14409:1875971258037120:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1789066047.700870:0:16555:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789066047.701062:0:14409:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789066047.701090:0:14409:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.204.123@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789066047.701104:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a32 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066047.701119:0:14409:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.123@tcp lock: ffff9cf0817a7e00/0x7555615576c83a2b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x7555615576c83a32 expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066048.037855:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066048.039443:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021248 00000100:00100000:0.0:1789066048.039464:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021248 00000100:00100000:0.0:1789066048.039594:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:0.0:1789066048.039609:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+11:13765:x1875971236021248:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789066048.039634:0:14407:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066048.039673:0:14407:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081654400/0x7555615576c83a39 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce0e8 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066048.039715:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081654400/0x7555615576c83a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e8 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066048.039730:0:14407:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081654400/0x7555615576c83a39 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e8 expref: 12 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066048.039742:0:14407:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654400, rc 0) 00000100:00100000:0.0:1789066048.039836:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13765:x1875971236021248:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 229us (1996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066048.039844:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 115 00000100:00100000:2.0:1789066048.050665:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066048.050753:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021376 00000100:00100000:1.0:1789066048.050767:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021376 00000100:00100000:1.0:1789066048.050837:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:1.0:1789066048.050849:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13765:x1875971236021376:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789066048.051255:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13765:x1875971236021376:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 405us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066048.051276:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 116 00000100:00100000:3.0:1789066048.065330:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066048.066122:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021504 00000100:00100000:0.0:1789066048.066141:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021504 00000100:00100000:0.0:1789066048.066227:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:0.0:1789066048.066241:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13765:x1875971236021504:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789066048.066606:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13765:x1875971236021504:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 366us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066048.066617:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 117 00000100:00100000:3.0:1789066048.072054:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066048.072248:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021632 00000100:00100000:0.0:1789066048.072263:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021632 00000100:00100000:0.0:1789066048.072345:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:0.0:1789066048.072359:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+12:13765:x1875971236021632:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789066048.072383:0:14405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066048.072410:0:14405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9cf081655200/0x7555615576c83a40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x64887942ebce0ef expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066048.072453:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9cf081655200/0x7555615576c83a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0ef expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066048.072467:0:14405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9cf081655200/0x7555615576c83a40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0ef expref: 13 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066048.072477:0:14405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655200, rc 0) 00000100:00100000:0.0:1789066048.072591:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13765:x1875971236021632:12345-192.168.204.23@tcp:101:ll_cfg_requeue.0 Request processed in 234us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066048.072599:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 118 00000100:00100000:3.0:1789066048.075330:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066048.075463:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021760 00000100:00100000:1.0:1789066048.075484:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021760 00000100:00100000:1.0:1789066048.075599:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:1.0:1789066048.075613:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13765:x1875971236021760:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789066048.076105:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13765:x1875971236021760:12345-192.168.204.23@tcp:501:ll_cfg_requeue.0 Request processed in 493us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066048.076115:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 119 00000100:00100000:3.0:1789066048.087878:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066048.088025:0:14407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236021888 00000100:00100000:1.0:1789066048.088040:0:14407:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236021888 00000100:00100000:1.0:1789066048.088117:0:14407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:1.0:1789066048.088129:0:14407:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13765:x1875971236021888:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789066048.088453:0:14407:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:13765:x1875971236021888:12345-192.168.204.23@tcp:503:ll_cfg_requeue.0 Request processed in 324us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066048.088463:0:14407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 120 00000100:00100000:0.0:1789066048.168461:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789066048.168495:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258037248:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789066048.168630:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066048.168740:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037248 00000100:00100000:0.0:1789066048.168751:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037248 00000100:00100000:0.0:1789066048.168829:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789066048.168840:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258037248:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789066048.168896:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789066048.168956:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3298:x1875971258037248:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066048.168989:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:0.0:1789066048.169020:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789066048.169085:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258037248:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789066048.358831:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066048.931712:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066048.931758:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066048.931783:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066048.931801:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066048.931818:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066048.931855:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066048.931895:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022272 00000100:00100000:3.0:1789066048.931912:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022272 00000100:00100000:3.0:1789066048.931985:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022528 00000100:00100000:3.0:1789066048.931988:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022528 00000100:00100000:3.0:1789066048.932002:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022144 00000100:00100000:3.0:1789066048.932004:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022144 00000100:00100000:3.0:1789066048.932029:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022656 00000100:00100000:3.0:1789066048.932032:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022656 00000100:00100000:3.0:1789066048.932052:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1789066048.932063:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236022272:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066048.932170:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bacbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236022272:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 108us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066048.932178:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1789066048.932209:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1789066048.932215:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236022528:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066048.932263:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bacb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236022528:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 48us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066048.932269:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:3.0:1789066048.932280:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1789066048.932285:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236022144:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066048.932306:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bacad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236022144:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 21us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066048.932312:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1789066048.932322:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1789066048.932327:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236022656:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066048.932347:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236022656:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 20us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066048.932353:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1789066048.932377:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022016 00000100:00100000:3.0:1789066048.932382:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022016 00000100:00100000:3.0:1789066048.932415:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022400 00000100:00100000:3.0:1789066048.932418:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022400 00000100:00100000:3.0:1789066048.932441:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:3.0:1789066048.932447:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236022016:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066048.932480:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236022016:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 32us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066048.932486:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:3.0:1789066048.932497:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:3.0:1789066048.932503:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07baca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2347:x1875971236022400:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066048.932544:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07baca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2347:x1875971236022400:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 39us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066048.932580:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00080000:0.0:1789066048.932627:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789066048.932642:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789066048.932645:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789066049.391652:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066050.407183:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789066050.727579:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789066050.727623:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258037376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789066050.727726:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066050.729717:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037376 00000100:00100000:0.0:1789066050.729737:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037376 00000100:00100000:0.0:1789066050.729836:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789066050.729848:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258037376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789066050.729897:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789066050.730145:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3297:x1875971258037376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 298us (2418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066050.730227:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789066050.730356:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258037504:0@lo:400:kworker.0 00000100:00100000:0.0:1789066050.730403:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066050.730438:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258038016:0@lo:400:kworker.0 00000100:00100000:0.0:1789066050.730464:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066050.730489:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789066050.730495:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258037632:0@lo:400:kworker.0 00000100:00100000:0.0:1789066050.730523:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789066050.731722:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789066050.731797:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258037888:0@lo:400:kworker.0 00000100:00100000:1.0:1789066050.731864:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066050.731904:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789066050.731911:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258037760:0@lo:400:kworker.0 00000100:00100000:1.0:1789066050.731935:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066050.732373:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037504 00000100:00100000:0.0:1789066050.732385:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037504 00000100:00100000:0.0:1789066050.732457:0:14405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1789066050.732467:0:14405:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258037504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789066050.732885:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258038016 00000100:00100000:3.0:1789066050.732891:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258038016 00000100:00100000:3.0:1789066050.732931:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037888 00000100:00100000:3.0:1789066050.732934:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037888 00000100:00100000:3.0:1789066050.732946:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037760 00000100:00100000:3.0:1789066050.732948:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037760 00000100:00100000:3.0:1789066050.732960:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789066050.732965:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971258038016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066050.733079:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789066050.733088:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258037888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066050.733129:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3298:x1875971258037888:12345-0@lo:400:kworker.0 Request processed in 43us (1265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066050.733136:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789066050.733528:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789066050.733537:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258037760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066050.733607:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3298:x1875971258037760:12345-0@lo:400:kworker.0 Request processed in 72us (1671us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066050.733613:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:1.0:1789066050.733631:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789066050.733680:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3297:1875971258037376:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789066050.733714:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3298:1875971258037760:0@lo:400:kworker.0 00000100:00100000:1.0:1789066050.733724:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3298:1875971258037888:0@lo:400:kworker.0 00000100:00100000:2.0:1789066050.737900:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258037632 00000100:00100000:2.0:1789066050.737925:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258037632 00000100:00100000:2.0:1789066050.738009:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789066050.738021:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258037632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789066050.738172:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258037632:12345-0@lo:400:kworker.0 Request processed in 153us (7648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066050.738181:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789066050.738345:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258037632:0@lo:400:kworker.0 00000100:00100000:2.0:1789066050.738358:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3295:1875971258037504:0@lo:400:kworker.0 00000100:00100000:0.0:1789066050.739772:0:14405:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d89850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3295:x1875971258037504:12345-0@lo:400:kworker.0 Request processed in 81us (2144us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066050.739795:0:14405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00080000:0.0:1789066050.739951:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789066050.741403:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3295:x1875971258038016:12345-0@lo:400:kworker.0 Request processed in 8426us (10926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066050.741420:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789066050.741502:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07f50f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3295:1875971258038016:0@lo:400:kworker.0 00000100:00100000:3.0:1789066051.271875:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.272198:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236022784 00000100:00100000:1.0:1789066051.272225:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236022784 00000100:00100000:1.0:1789066051.272322:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00100000:1.0:1789066051.272336:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07bac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+6:14422:x1875971236022784:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789066051.272364:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789066051.272397:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a47 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce0f6 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.272485:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.272506:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.272544:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.272622:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.272630:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.272637:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273032:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c83a5c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273042:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c83a5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273049:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c83a5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789066051.273080:0:14411:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789066051.273085:0:14411:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789066051.273129:0:14411:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c83a5c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273142:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273150:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273169:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273176:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066051.273182:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273192:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273208:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:1.0:1789066051.273211:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066051.273220:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273228:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83a4e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273245:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273252:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273259:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273265:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066051.273268:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273284:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273293:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9cf06a8c0a00) 00010000:00010000:1.0:1789066051.273296:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066051.273299:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273306:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83a55 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273351:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a47 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0f6 expref: 8 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273366:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6800/0x7555615576c83a5c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0f6 expref: 7 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.273374:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf06a8c0000) 00010000:00010000:1.0:1789066051.273376:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789066051.273379:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a6800, rc 0) 00000100:00100000:1.0:1789066051.273478:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07bac9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+7:14422:x1875971236022784:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1146us (1630us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066051.273489:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 15 00000100:00080000:0.0:1789066051.273616:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789066051.280330:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.280464:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023040 00000100:00100000:2.0:1789066051.280480:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023040 00000100:00100000:2.0:1789066051.280624:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1789066051.280637:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+7:14422:x1875971236023040:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789066051.280665:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.280693:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83a63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce0fd expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.280806:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.280824:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.280838:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281035:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281061:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281074:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281477:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83a78 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281488:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83a78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281495:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83a78 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.281508:0:14414:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789066051.281776:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281785:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281792:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281799:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1de00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.281803:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281811:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281824:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9cf06a8c0000) 00010000:00010000:2.0:1789066051.281827:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.281832:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281849:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83a6a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281864:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281870:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281876:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281881:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.281885:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281890:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281898:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.281901:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.281903:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.281909:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83a71 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.282385:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83a63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0fd expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.282415:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d600/0x7555615576c83a78 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0fd expref: 9 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.282423:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf042e0f700) 00010000:00010000:2.0:1789066051.282426:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.282428:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d600, rc 0) 00000100:00100000:2.0:1789066051.282514:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+9:14422:x1875971236023040:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1879us (2199us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789066051.282524:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:3.0:1789066051.287323:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.287998:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023168 00000100:00100000:1.0:1789066051.288014:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023168 00000100:00100000:1.0:1789066051.288093:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:1.0:1789066051.288107:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+9:14422:x1875971236023168:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789066051.288273:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+9:14422:x1875971236023168:12345-192.168.204.23@tcp:59:lhsmtool_posix.0 Request processed in 168us (965us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066051.288282:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1789066051.352204:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066051.352304:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023296 00000100:00100000:0.0:1789066051.352320:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023296 00000100:00100000:0.0:1789066051.352470:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:0.0:1789066051.352484:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+9:14428:x1875971236023296:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:0.0:1789066051.352512:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066051.352540:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c83a86 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce104 expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.352680:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.352700:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.352716:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.352733:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.352741:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.352793:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353484:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353499:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353506:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353513:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789066051.353519:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353528:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353593:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:0.0:1789066051.353598:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789066051.353605:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353612:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655e00/0x7555615576c83a8d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353626:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353633:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353648:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353654:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789066051.353657:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353664:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353673:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf043149d00) 00010000:00010000:0.0:1789066051.353675:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789066051.353679:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353685:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83a94 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353737:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c83a86 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce104 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.353749:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:0.0:1789066051.353752:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789066051.353756:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655400/0x7555615576c83a86 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce104 expref: 10 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.354131:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655400, rc 0) 00000100:00100000:0.0:1789066051.354301:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+9:14428:x1875971236023296:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1817us (2109us total) trans 0 rc 301/301 00000100:00100000:0.0:1789066051.354325:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:3.0:1789066051.362423:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.363369:0:14421:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023424 00000100:00100000:2.0:1789066051.363386:0:14421:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023424 00000100:00100000:2.0:1789066051.363534:0:14421:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:2.0:1789066051.363605:0:14421:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d8884011-f51c-4c21-8191-38ad45143351+9:14428:x1875971236023424:12345-192.168.204.23@tcp:700:lfs.0 00000100:00100000:2.0:1789066051.363749:0:14421:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:d8884011-f51c-4c21-8191-38ad45143351+9:14428:x1875971236023424:12345-192.168.204.23@tcp:700:lfs.0 Request processed in 204us (1344us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.363757:0:14421:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:3.0:1789066051.383767:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.384017:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023680 00000100:00100000:1.0:1789066051.384032:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023680 00000100:00100000:1.0:1789066051.384115:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:1.0:1789066051.384128:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+9:14428:x1875971236023680:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:1.0:1789066051.384223:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789066051.384258:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c839c9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce07f expref: 9 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.384287:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:1.0:1789066051.384294:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789066051.384660:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.384679:0:14411:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 5 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.384690:0:14411:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.384736:0:14411:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 5 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.384752:0:14411:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 5 pid: 14411 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066051.385117:0:14411:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14411:1875971258038144:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789066051.385312:0:14411:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf07fd1ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1789066051.390133:0:14411:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07fc95f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14411:1875971258038144:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789066051.390175:0:14411:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066051.398306:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.399037:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023808 00000100:00100000:1.0:1789066051.399052:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023808 00010000:00010000:1.0:1789066051.399128:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 6 pid: 14411 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066051.399201:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1789066051.399212:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2348:x1875971236023808:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789066051.399232:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789066051.399240:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 6 pid: 14411 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.399256:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 6 pid: 14411 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.399284:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654a00/0x7555615576c83a01 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce0e1 expref: 6 pid: 14411 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.399305:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:1.0:1789066051.399311:0:14399:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.399342:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.399350:0:14399:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.399390:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789066051.399467:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2348:x1875971236023808:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 256us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066051.399476:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00080000:0.0:1789066051.399591:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789066051.400266:0:14411:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.400281:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.400335:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.400349:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.400361:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789066051.409696:0:14411:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789066051.409719:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.409731:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.409739:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.409747:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789066051.409752:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.409760:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.409778:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0f500) 00010000:00010000:3.0:1789066051.409781:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789066051.409787:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.409807:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6e00/0x7555615576c83a9b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789066051.411853:0:14411:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000d5bda5f6 reply state 00000000be556e34 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066051.411867:0:14411:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789066051.412670:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+10:14428:x1875971236023680:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 28523us (28904us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789066051.412683:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00010000:00010000:1.0:1789066051.424255:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.424275:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.424282:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.424289:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066051.424294:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.424302:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.424320:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf043e52d00) 00010000:00010000:1.0:1789066051.424323:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066051.424327:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.424354:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83aa2 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.430106:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789066051.527414:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.527782:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236023936 00000100:00100000:2.0:1789066051.527797:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236023936 00000100:00100000:2.0:1789066051.527876:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:2.0:1789066051.527887:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+9:14436:x1875971236023936:12345-192.168.204.23@tcp:101:lctl.0 00010000:00010000:2.0:1789066051.527913:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.527950:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83aa9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce10b expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.528021:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83ab0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.528049:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.528063:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.528113:0:14414:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789066051.528116:0:14414:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066051.528156:0:14414:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.528183:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83aa9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce10b expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.528202:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1de00/0x7555615576c83ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce10b expref: 10 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.528210:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.528212:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789066051.528216:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1de00, rc 0) 00000100:00100000:2.0:1789066051.528300:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+10:14436:x1875971236023936:12345-192.168.204.23@tcp:101:lctl.0 Request processed in 414us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.528308:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1789066051.571156:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.571360:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236024064 00000100:00100000:2.0:1789066051.571377:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236024064 00000100:00100000:2.0:1789066051.571453:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:2.0:1789066051.571465:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:14437:x1875971236024064:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789066051.571504:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.571624:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83ab7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce112 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.571712:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d000/0x7555615576c83abe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.571732:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d000/0x7555615576c83abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.571747:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d000/0x7555615576c83abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.571796:0:15531:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789066051.571801:0:15531:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066051.571829:0:15531:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d000/0x7555615576c83abe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.571861:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83ab7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce112 expref: 7 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.571902:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d000/0x7555615576c83abe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce112 expref: 6 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.571913:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.571916:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789066051.571922:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d000, rc 0) 00000100:00100000:2.0:1789066051.572022:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:14437:x1875971236024064:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 558us (881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.572030:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:3.0:1789066051.576098:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.576196:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236024192 00000100:00100000:2.0:1789066051.576219:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236024192 00000100:00100000:2.0:1789066051.576298:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:2.0:1789066051.576311:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:14437:x1875971236024192:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789066051.576339:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.576368:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83ac5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce119 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.576454:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.576472:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.576485:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.576501:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.576509:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.576516:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577070:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83ada lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577095:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83ada lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577108:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83ada lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.577180:0:14414:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789066051.577185:0:14414:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066051.577208:0:14414:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83ada lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577222:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577229:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577236:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577243:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.577247:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577255:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577268:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.577271:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.577276:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577283:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83acc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577301:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577318:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577323:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577329:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.577332:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577339:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577346:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789066051.577349:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.577351:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577358:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83ad3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577399:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83ac5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce119 expref: 8 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577414:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83ada lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce119 expref: 7 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.577421:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fb00) 00010000:00010000:2.0:1789066051.577423:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789066051.577431:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c800, rc 0) 00000100:00100000:2.0:1789066051.577531:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+7:14437:x1875971236024192:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 1221us (1661us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.577541:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 22 00000100:00100000:0.0:1789066051.581707:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.581806:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236024448 00000100:00100000:2.0:1789066051.581823:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236024448 00000100:00100000:2.0:1789066051.581916:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:2.0:1789066051.581928:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+7:14437:x1875971236024448:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789066051.581949:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.581973:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83ae1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce120 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.582060:0:15531:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789066051.582184:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83ae1 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce120 expref: 9 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.582198:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.582201:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789066051.582206:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83ae1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce120 expref: 9 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.582220:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789066051.582294:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+8:14437:x1875971236024448:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 368us (602us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789066051.582302:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 23 00000100:00100000:3.0:1789066051.585108:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066051.590262:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236024704 00000100:00100000:0.0:1789066051.590285:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236024704 00000100:00100000:0.0:1789066051.590388:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 24 00000100:00100000:0.0:1789066051.590402:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+8:14437:x1875971236024704:12345-192.168.204.23@tcp:36:lfs.0 00010000:00010000:0.0:1789066051.593327:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066051.593390:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83ada lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce119 expref: 8 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.593425:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fb00) 00010000:00010000:0.0:1789066051.593443:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789066051.593493:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.593511:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066051.593524:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789066051.597523:0:14413:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 00000000212ee5ad reply state 00000000638d4987 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066051.598013:0:14413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1789066051.598031:0:14413:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789066051.598172:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+9:14437:x1875971236024704:12345-192.168.204.23@tcp:36:lfs.0 Request processed in 7768us (13074us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1789066051.598215:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 24 00010000:00010000:2.0:1789066051.604456:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.604523:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.604532:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.604954:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.604962:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.604973:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.604995:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf043149d00) 00010000:00010000:2.0:1789066051.604998:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789066051.605005:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.605012:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655800/0x7555615576c83aef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066051.613317:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066051.613730:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236024960 00000100:00100000:3.0:1789066051.613745:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236024960 00000100:00100000:3.0:1789066051.613827:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1789066051.613841:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+8:14437:x1875971236024960:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:3.0:1789066051.614190:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+9:14437:x1875971236024960:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 341us (875us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789066051.614200:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1789066051.623747:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.623934:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236025216 00000100:00100000:1.0:1789066051.623949:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236025216 00000100:00100000:1.0:1789066051.624031:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:1.0:1789066051.624044:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+9:14437:x1875971236025216:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:1.0:1789066051.624077:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789066051.624106:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce127 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.624690:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.624712:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.624727:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.624745:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.624752:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.624758:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789066051.624925:0:14411:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789066051.625072:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625080:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625087:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625094:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066051.625099:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625108:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625122:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:1.0:1789066051.625125:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066051.625131:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625137:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7000/0x7555615576c83afd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625153:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625159:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.625164:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626088:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066051.626094:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626103:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626116:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf06a8c0a00) 00010000:00010000:1.0:1789066051.626120:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066051.626123:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626130:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a6a00/0x7555615576c83b04 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626225:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83af6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce127 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626238:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:1.0:1789066051.626240:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789066051.626244:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce127 expref: 11 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.626254:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf0817a7600, rc 0) 00000100:00100000:1.0:1789066051.626351:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+10:14437:x1875971236025216:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 2309us (2620us total) trans 8589934598 rc 301/301 00000100:00100000:1.0:1789066051.626361:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 25 00000100:00100000:0.0:1789066051.639137:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.639277:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236025344 00000100:00100000:2.0:1789066051.639291:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236025344 00000100:00100000:2.0:1789066051.639371:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:2.0:1789066051.639385:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+10:14437:x1875971236025344:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789066051.639418:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.639453:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b12 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce12e expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.639770:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.639805:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.639820:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.639855:0:14414:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789066051.639859:0:14414:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066051.639879:0:14414:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.639912:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b12 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 12 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.639934:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.639945:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789066051.639949:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789066051.639953:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1cc00, rc 0) 00000100:00100000:2.0:1789066051.640078:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+11:14437:x1875971236025344:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 696us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.640087:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 26 00000100:00100000:0.0:1789066051.655121:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066051.655226:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236025472 00000100:00100000:3.0:1789066051.655241:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236025472 00000100:00100000:3.0:1789066051.655320:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:3.0:1789066051.655336:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+11:14437:x1875971236025472:12345-192.168.204.23@tcp:37:lfs.0 00000100:00100000:2.0:1789066051.663182:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+11:14437:x1875971236025472:12345-192.168.204.23@tcp:37:lfs.0 Request processed in 7832us (8056us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.663198:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:0.0:1789066051.668340:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.668469:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236025728 00000100:00100000:1.0:1789066051.668515:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236025728 00000100:00100000:1.0:1789066051.668661:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1789066051.668676:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+11:14437:x1875971236025728:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789066051.669038:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818df050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+12:14437:x1875971236025728:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 364us (712us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1789066051.669048:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:0.0:1789066051.728424:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.728616:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236025856 00000100:00100000:2.0:1789066051.728697:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236025856 00000100:00100000:2.0:1789066051.728795:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:2.0:1789066051.728807:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+10:14443:x1875971236025856:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:2.0:1789066051.728835:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.728861:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b20 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce135 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729011:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729030:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729043:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729060:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729068:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729075:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729201:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83b35 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729209:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83b35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729216:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83b35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.729262:0:15531:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789066051.729266:0:15531:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066051.729315:0:15531:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83b35 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729330:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729337:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729344:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729351:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.729357:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729365:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729381:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.729384:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.729390:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729397:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b27 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729414:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729430:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729437:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729442:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.729445:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729451:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729459:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9cf042e0ff00) 00010000:00010000:2.0:1789066051.729462:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066051.729465:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729471:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b2e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729513:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b20 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce135 expref: 12 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729528:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c600/0x7555615576c83b35 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce135 expref: 11 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.729535:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789066051.729538:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789066051.729858:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c600, rc 0) 00000100:00100000:2.0:1789066051.730085:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+11:14443:x1875971236025856:12345-192.168.204.23@tcp:101:bash.0 Request processed in 1279us (1677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.730096:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 27 00000100:00100000:0.0:1789066051.734905:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066051.735032:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236026112 00000100:00100000:3.0:1789066051.735046:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236026112 00000100:00100000:3.0:1789066051.735117:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 28 00000100:00100000:3.0:1789066051.735129:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+11:14443:x1875971236026112:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789066051.735159:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066051.735189:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83b3c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce13c expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.735344:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.735364:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.735375:0:14413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.735422:0:14413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 11 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.735448:0:14413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 11 pid: 14414 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066051.735465:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14413:1875971258038272:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789066051.735895:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a530b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789066051.739889:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.739998:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236026240 00000100:00100000:2.0:1789066051.740012:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236026240 00010000:00010000:2.0:1789066051.740075:0:14398:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 12 pid: 14414 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066051.740134:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1789066051.740147:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+12:2347:x1875971236026240:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789066051.740167:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066051.740175:0:14398:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 12 pid: 14414 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.740190:0:14398:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 12 pid: 14414 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.740219:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:2.0:1789066051.740226:0:14398:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.740238:0:14398:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.740247:0:14398:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.740270:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789066051.740284:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83b19 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce12e expref: 12 pid: 14414 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066051.740313:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14413:1875971258038272:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789066051.740344:0:14413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.740355:0:14413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.740361:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066051.740368:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+11:2347:x1875971236026240:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 224us (494us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.740377:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00010000:00010000:3.0:1789066051.740393:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.740403:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.740412:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742123:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742144:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742155:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789066051.742170:0:14413:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789066051.742211:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742227:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742234:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742240:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031000 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789066051.742246:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742254:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742269:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:3.0:1789066051.742272:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789066051.742278:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742284:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b43 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789066051.742301:0:14413:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000048fbd8e7 reply state 00000000518706fc transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066051.742313:0:14413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789066051.742360:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83b3c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 14 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742379:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 13 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.742398:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789066051.742400:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789066051.742403:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031800, rc 0) 00000100:00100000:3.0:1789066051.742842:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+14:14443:x1875971236026112:12345-192.168.204.23@tcp:101:bash.0 Request processed in 7712us (7950us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1789066051.742852:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 28 00010000:00010000:1.0:1789066051.757726:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.757753:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.757762:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.757769:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030c00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066051.757775:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.757784:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066051.757856:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00010000:00010000:1.0:1789066051.757871:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9cf043e52000) 00010000:00010000:1.0:1789066051.757875:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066051.757882:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.757889:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030c00/0x7555615576c83b4a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066051.757966:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236026368 00000100:00100000:3.0:1789066051.757981:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236026368 00000100:00100000:3.0:1789066051.758067:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:3.0:1789066051.758081:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+13:14443:x1875971236026368:12345-192.168.204.23@tcp:101:bash.0 00010000:00010000:3.0:1789066051.758115:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066051.758137:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83b5f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce143 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758231:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758246:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758258:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789066051.758312:0:14411:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789066051.758318:0:14411:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789066051.758351:0:14411:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758391:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758423:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83b5f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 15 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758439:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066051.758447:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789066051.758449:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789066051.758452:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031000, rc 0) 00000100:00100000:3.0:1789066051.758931:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+14:14443:x1875971236026368:12345-192.168.204.23@tcp:101:bash.0 Request processed in 852us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066051.758941:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 29 00000100:00100000:0.0:1789066051.762675:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.762757:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236026624 00000100:00100000:1.0:1789066051.762800:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236026624 00000100:00100000:1.0:1789066051.762867:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:1.0:1789066051.762879:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8884011-f51c-4c21-8191-38ad45143351+14:14443:x1875971236026624:12345-192.168.204.23@tcp:35:bash.0 00000100:00100000:1.0:1789066051.763380:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8884011-f51c-4c21-8191-38ad45143351+15:14443:x1875971236026624:12345-192.168.204.23@tcp:35:bash.0 Request processed in 501us (718us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1789066051.763390:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:0.0:1789066051.846758:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.846892:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236026880 00000100:00100000:2.0:1789066051.846906:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236026880 00000100:00100000:2.0:1789066051.846983:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:2.0:1789066051.846995:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+15:14453:x1875971236026880:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789066051.847033:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.847063:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce14a expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.847193:0:14414:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789066051.847366:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b6d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce14a expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.847385:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9cf042e0fd00) 00010000:00010000:2.0:1789066051.847388:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789066051.847395:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce14a expref: 17 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.847414:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1dc00, rc 0) 00000100:00100000:2.0:1789066051.847497:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+16:14453:x1875971236026880:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 504us (754us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789066051.847506:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 30 00000100:00100000:0.0:1789066051.854422:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.854717:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236027136 00000100:00100000:2.0:1789066051.854730:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236027136 00000100:00100000:2.0:1789066051.854959:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1789066051.854973:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+16:14453:x1875971236027136:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:2.0:1789066051.855319:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+17:14453:x1875971236027136:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 348us (913us total) trans 8589934603 rc 0/0 00000100:00100000:2.0:1789066051.855329:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000040:00080000:3.0:1789066051.878744:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789066051.891714:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.891853:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236027392 00000100:00100000:2.0:1789066051.891868:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236027392 00000100:00100000:2.0:1789066051.891949:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:2.0:1789066051.891962:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+17:14456:x1875971236027392:12345-192.168.204.23@tcp:101:lfs.0 00010000:00010000:2.0:1789066051.891995:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066051.892022:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b7b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce151 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.892155:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b82 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.892174:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.892191:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b82 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066051.892206:0:15531:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789066051.892403:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b7b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce151 expref: 20 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.892427:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b82 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce151 expref: 19 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.892443:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066051.892455:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789066051.892462:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1d800, rc 0) 00000100:00100000:2.0:1789066051.892634:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+19:14456:x1875971236027392:12345-192.168.204.23@tcp:101:lfs.0 Request processed in 673us (936us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1789066051.892645:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:0.0:1789066051.897321:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066051.897374:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066051.897459:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236027520 00000100:00100000:2.0:1789066051.897473:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236027520 00000100:00100000:2.0:1789066051.897633:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:2.0:1789066051.897647:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+19:14456:x1875971236027520:12345-192.168.204.23@tcp:54:lfs.0 00010000:00010000:2.0:1789066051.897745:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.897937:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.897954:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.897992:0:14414:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.898000:0:14414:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.898007:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.898014:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066051.898020:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.898051:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.898068:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066051.898071:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789066051.898077:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066051.898084:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b90 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066051.898169:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+19:14456:x1875971236027520:12345-192.168.204.23@tcp:54:lfs.0 Request processed in 524us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066051.898177:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 32 00000100:00100000:1.0:1789066051.899022:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236027648 00000100:00100000:1.0:1789066051.899034:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236027648 00000100:00100000:1.0:1789066051.899092:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1789066051.899102:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8884011-f51c-4c21-8191-38ad45143351+19:2350:x1875971236027648:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789066051.899117:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789066051.899140:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83b82 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce151 expref: 19 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066051.899157:0:14399:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:1.0:1789066051.899161:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789066051.899213:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8884011-f51c-4c21-8191-38ad45143351+18:2350:x1875971236027648:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 112us (1838us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066051.899220:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:0.0:1789066051.907083:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066051.907189:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236027904 00000100:00100000:1.0:1789066051.907203:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236027904 00000100:00100000:1.0:1789066051.907285:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:1.0:1789066051.907298:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8884011-f51c-4c21-8191-38ad45143351+18:14456:x1875971236027904:12345-192.168.204.23@tcp:35:lfs.0 00000100:00100000:1.0:1789066051.907685:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8884011-f51c-4c21-8191-38ad45143351+19:14456:x1875971236027904:12345-192.168.204.23@tcp:35:lfs.0 Request processed in 388us (616us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1789066051.907695:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:0.0:1789066052.160188:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.160307:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236028160 00000100:00100000:2.0:1789066052.160321:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236028160 00000100:00100000:2.0:1789066052.160401:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:2.0:1789066052.160413:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+19:14487:x1875971236028160:12345-192.168.204.23@tcp:101:cat.0 00010000:00010000:2.0:1789066052.160444:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066052.160473:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b97 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce158 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.160663:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b9e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.160682:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.160696:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b9e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066052.160729:0:15531:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789066052.160929:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83b97 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce158 expref: 22 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.160954:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b9e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce158 expref: 21 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.160965:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.160968:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789066052.160973:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789066052.161057:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+21:14487:x1875971236028160:12345-192.168.204.23@tcp:101:cat.0 Request processed in 646us (885us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1789066052.161067:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 33 00000100:00100000:0.0:1789066052.164030:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.164688:0:14398:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236028288 00000100:00100000:2.0:1789066052.164703:0:14398:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236028288 00000100:00100000:2.0:1789066052.164869:0:14398:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:0.0:1789066052.164873:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.164881:0:14398:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8884011-f51c-4c21-8191-38ad45143351+21:2349:x1875971236028288:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789066052.164902:0:14398:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066052.164999:0:14398:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83b9e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce158 expref: 21 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.165023:0:14398:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.165030:0:14398:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789066052.165090:0:14416:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236028544 00000100:00100000:3.0:1789066052.165095:0:14416:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236028544 00000100:00100000:2.0:1789066052.165103:0:14398:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d8884011-f51c-4c21-8191-38ad45143351+21:2349:x1875971236028288:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 224us (1085us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.165110:0:14398:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1789066052.165129:0:14416:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:3.0:1789066052.165136:0:14416:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8884011-f51c-4c21-8191-38ad45143351+21:14487:x1875971236028544:12345-192.168.204.23@tcp:35:cat.0 00000100:00100000:3.0:1789066052.166421:0:14416:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d8884011-f51c-4c21-8191-38ad45143351+21:14487:x1875971236028544:12345-192.168.204.23@tcp:35:cat.0 Request processed in 1272us (1534us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1789066052.166436:0:14416:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 8 00000100:00100000:0.0:1789066052.224124:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066052.224540:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236028800 00000100:00100000:3.0:1789066052.224603:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236028800 00000100:00100000:3.0:1789066052.224692:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:3.0:1789066052.224706:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+21:14493:x1875971236028800:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:3.0:1789066052.224775:0:14413:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066052.224804:0:14413:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce15f expref: -99 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.224944:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.224963:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.224973:0:14413:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.224983:0:14413:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.225035:0:14413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 22 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.225053:0:14413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 22 pid: 14411 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066052.225070:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14413:1875971258038400:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789066052.225214:0:14413:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.225225:0:14413:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 22 pid: 14413 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066052.225248:0:14413:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081691180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14413:1875971258038528:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789066052.225275:0:14413:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a530180 going to sleep for 11 seconds 00000100:00100000:3.0:1789066052.229693:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081693b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14413:1875971258038400:192.168.204.23@tcp:104: 00000100:00100000:3.0:1789066052.229711:0:14413:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081691180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14413:1875971258038528:192.168.204.23@tcp:104: 00010000:00010000:3.0:1789066052.229749:0:14413:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066052.229874:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066052.229914:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.230002:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236029056 00000100:00100000:2.0:1789066052.230012:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236029056 00010000:00010000:2.0:1789066052.230059:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 23 pid: 14413 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066052.230104:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236028928 00000100:00100000:2.0:1789066052.230108:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236028928 00010000:00010000:2.0:1789066052.230123:0:14397:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 24 pid: 14411 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066052.230155:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:2.0:1789066052.230166:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8884011-f51c-4c21-8191-38ad45143351+24:2348:x1875971236029056:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789066052.230186:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066052.230195:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 24 pid: 14413 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230207:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 24 pid: 14413 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230234:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031800/0x7555615576c83b51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce13c expref: 24 pid: 14413 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230254:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.230260:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230271:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230300:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789066052.230367:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8884011-f51c-4c21-8191-38ad45143351+23:2348:x1875971236029056:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 202us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.230376:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:2.0:1789066052.230433:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 12 00000100:00100000:2.0:1789066052.230440:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8884011-f51c-4c21-8191-38ad45143351+22:2348:x1875971236028928:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789066052.230449:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066052.230454:0:14397:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 22 pid: 14411 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230466:0:14397:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 22 pid: 14411 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230478:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031000/0x7555615576c83b66 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce143 expref: 22 pid: 14411 timeout: 611 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230488:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.230492:0:14397:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230501:0:14397:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230510:0:14397:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.230535:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789066052.230620:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8884011-f51c-4c21-8191-38ad45143351+21:2348:x1875971236028928:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 179us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.230628:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 12 00010000:00010000:3.0:1789066052.230996:0:14413:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.231006:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789066052.231033:0:14413:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789066052.231260:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce15f expref: 22 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.231282:0:14413:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030400/0x7555615576c83bb3 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce15f expref: 21 pid: 14413 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.231291:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:3.0:1789066052.231294:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789066052.231297:0:14413:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030400, rc 0) 00000100:00100000:3.0:1789066052.231352:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+21:14493:x1875971236028800:12345-192.168.204.23@tcp:101:dd.0 Request processed in 6650us (7245us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1789066052.231360:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 34 00000100:00100000:0.0:1789066052.237940:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.238058:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236029312 00000100:00100000:2.0:1789066052.238071:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236029312 00000100:00100000:2.0:1789066052.238145:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 35 00000100:00100000:2.0:1789066052.238157:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+21:14493:x1875971236029312:12345-192.168.204.23@tcp:36:dd.0 00010000:00010000:2.0:1789066052.238536:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.238606:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.238621:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789066052.238687:0:15531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1789066052.238730:0:15531:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000008b954d09 reply state 0000000033a92a7e transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066052.238741:0:15531:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789066052.238902:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+24:14493:x1875971236029312:12345-192.168.204.23@tcp:36:dd.0 Request processed in 746us (977us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1789066052.238910:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 35 00000020:00080000:2.0:1789066052.238917:0:15531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789066052.241696:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.241720:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.241751:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.241759:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066052.241774:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.241785:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.241806:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.241810:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066052.241816:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.241823:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bc1 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066052.244129:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.244234:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236029440 00000100:00100000:2.0:1789066052.244248:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236029440 00000100:00100000:2.0:1789066052.244324:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:2.0:1789066052.244337:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+23:14493:x1875971236029440:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1789066052.244369:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066052.244396:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bc8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce166 expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.244485:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce166 expref: 24 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.244535:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bc8 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce166 expref: 24 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.244596:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.244600:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789066052.244605:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789066052.244685:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+24:14493:x1875971236029440:12345-192.168.204.23@tcp:101:dd.0 Request processed in 350us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.244695:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 36 00000100:00100000:0.0:1789066052.254520:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.254899:0:14397:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236029696 00000100:00100000:2.0:1789066052.254911:0:14397:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236029696 00000100:00100000:2.0:1789066052.255034:0:14397:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:2.0:1789066052.255047:0:14397:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8884011-f51c-4c21-8191-38ad45143351+24:14493:x1875971236029696:12345-192.168.204.23@tcp:103:dd.0 00010000:00010000:2.0:1789066052.255068:0:14397:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066052.255102:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bc8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce166 expref: 24 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.255125:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.255132:0:14397:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789066052.255239:0:14397:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081769f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d8884011-f51c-4c21-8191-38ad45143351+23:14493:x1875971236029696:12345-192.168.204.23@tcp:103:dd.0 Request processed in 194us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.255248:0:14397:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:0.0:1789066052.257828:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.257927:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236029824 00000100:00100000:2.0:1789066052.257940:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236029824 00000100:00100000:2.0:1789066052.258048:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:2.0:1789066052.258061:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+23:14493:x1875971236029824:12345-192.168.204.23@tcp:58:dd.0 00010000:00010000:2.0:1789066052.258211:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.258231:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.258246:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789066052.259401:0:15531:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789066052.260078:0:15531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1789066052.260180:0:15531:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1789066052.260394:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+23:14493:x1875971236029824:12345-192.168.204.23@tcp:58:dd.0 Request processed in 2328us (2625us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.260409:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 37 00000100:00100000:0.0:1789066052.263335:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.264620:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236029952 00000100:00100000:2.0:1789066052.264645:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236029952 00000100:00100000:2.0:1789066052.264783:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 38 00000100:00100000:2.0:1789066052.264796:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+23:14493:x1875971236029952:12345-192.168.204.23@tcp:101:dd.0 00010000:00010000:2.0:1789066052.264923:0:14414:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789066052.264954:0:14414:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce16d expref: -99 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.265036:0:14414:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.265048:0:14414:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 24 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.265073:0:14414:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.265105:0:14414:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 24 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.265122:0:14414:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.265126:0:14414:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789066052.265130:0:14414:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 24 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.265138:0:14414:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf07fd1c000, rc 0) 00000100:00100000:2.0:1789066052.265272:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+24:14493:x1875971236029952:12345-192.168.204.23@tcp:101:dd.0 Request processed in 478us (1951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.265280:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 38 00010000:00010000:0.0:1789066052.453833:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789066052.903122:0:14447:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789066052.903137:0:14447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789066052.903180:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789066052.903187:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789066052.903362:0:14447:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081691180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14447:1875971258038656:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789066052.904334:0:14447:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf06a530e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789066052.918726:0:14447:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081691180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14447:1875971258038656:192.168.204.23@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789066052.925092:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.925393:0:14423:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236030080 00000100:00100000:2.0:1789066052.925407:0:14423:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236030080 00000100:00100000:2.0:1789066052.925476:0:14423:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:2.0:1789066052.925498:0:14423:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030080:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1789066052.925667:0:14423:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030080:12345-192.168.204.23@tcp:900:lhsmtool_posix.0 Request processed in 178us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.925677:0:14423:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:0.0:1789066052.931155:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066052.931314:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236030208 00000100:00100000:3.0:1789066052.931330:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236030208 00000100:00100000:3.0:1789066052.931887:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:3.0:1789066052.931903:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030208:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789066052.931960:0:14411:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789066052.932127:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030208:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 228us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066052.932137:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 39 00000100:00100000:0.0:1789066052.966799:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066052.967066:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236030336 00000100:00100000:3.0:1789066052.967082:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236030336 00000100:00100000:3.0:1789066052.967162:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:3.0:1789066052.967174:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030336:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789066052.967291:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.967313:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066052.967331:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.970804:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.970831:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971199:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971253:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971263:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971271:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789066052.971388:0:14413:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789066052.971393:0:14413:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789066052.971410:0:14413:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971423:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971430:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971438:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971444:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030a00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066052.971449:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971458:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971947:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf042e0f700) 00010000:00010000:2.0:1789066052.971960:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066052.971967:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971974:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030a00/0x7555615576c83bdd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.971994:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972000:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972005:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972010:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066052.972013:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972018:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972024:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9cf042e0ff00) 00010000:00010000:2.0:1789066052.972027:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066052.972030:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972034:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1d800/0x7555615576c83be4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972052:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972064:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972070:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972075:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1cc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066052.972078:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972083:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972092:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:2.0:1789066052.972094:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066052.972097:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066052.972102:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83beb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066052.973073:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030336:12345-192.168.204.23@tcp:34:lhsmtool_posix.0 Request processed in 5892us (6280us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.973088:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 40 00000100:00100000:1.0:1789066052.980297:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066052.980384:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236030592 00000100:00100000:0.0:1789066052.980395:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236030592 00000100:00100000:0.0:1789066052.980454:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1789066052.980472:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+24:14494:x1875971236030592:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789066052.980492:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066052.980511:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83bf2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce174 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.980661:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.980677:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.980689:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789066052.980701:0:15531:0:(mdt_handler.c:924:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789066052.980812:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.980819:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.980826:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981031:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:0.0:1789066052.981037:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981045:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981061:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:0.0:1789066052.981064:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789066052.981070:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981076:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83bf9 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981145:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83bf2 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce174 expref: 26 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981156:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9cf042e0f700) 00010000:00010000:0.0:1789066052.981158:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789066052.981162:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83bf2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce174 expref: 26 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066052.981172:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654e00, rc 0) 00000100:00100000:0.0:1789066052.981239:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+25:14494:x1875971236030592:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 776us (952us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789066052.981247:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 41 00000100:00100000:0.0:1789066052.990265:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066052.990532:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236030720 00000100:00100000:2.0:1789066052.990591:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236030720 00000100:00100000:2.0:1789066052.990661:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:2.0:1789066052.990672:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+25:14494:x1875971236030720:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789066052.990712:0:14414:0:(mdt_handler.c:8031:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789066052.991791:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+25:14494:x1875971236030720:12345-192.168.204.23@tcp:53:lhsmtool_posix.0 Request processed in 1113us (1529us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066052.991805:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 42 00000100:00100000:1.0:1789066053.016201:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.016581:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236030976 00000100:00100000:0.0:1789066053.016594:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236030976 00000100:00100000:0.0:1789066053.016674:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00100000:0.0:1789066053.016686:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+25:14494:x1875971236030976:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789066053.016707:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066053.016728:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c07 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce17b expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789066053.017605:0:15531:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x240000400:0x7:0x0], count =27 00000004:00080000:0.0:1789066053.017614:0:15531:0:(osp_object.c:1645:osp_create()) Writing gap [0x240000400:0x7:0x0]+27 in llog 00000004:00080000:0.0:1789066053.017665:0:15531:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x22:0x0], index 0: 0 00010000:00010000:0.0:1789066053.017953:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c0e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.017969:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.017981:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c0e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.018043:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c07 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce17b expref: 28 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.018062:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c0e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce17b expref: 27 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.018071:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149000) 00010000:00010000:0.0:1789066053.018074:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789066053.018077:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654600, rc 0) 00000100:00100000:0.0:1789066053.018158:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+27:14494:x1875971236030976:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 1474us (1968us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1789066053.018167:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 43 00000100:00080000:1.0:1789066053.019454:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789066053.033263:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.033356:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236031232 00000100:00100000:3.0:1789066053.033367:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236031232 00000100:00100000:3.0:1789066053.033429:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:3.0:1789066053.033440:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+27:14494:x1875971236031232:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789066053.033616:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789066053.033644:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c0e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce17b expref: 27 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033664:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149000) 00010000:00010000:3.0:1789066053.033679:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789066053.033703:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033720:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033729:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033744:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033752:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033759:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033830:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033853:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033860:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.033866:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030e00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789066053.033871:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036455:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036478:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9cf042e0fe00) 00010000:00010000:3.0:1789066053.036481:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789066053.036487:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036494:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c1c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036517:0:14413:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036523:0:14413:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036529:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036534:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031200 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789066053.036584:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036591:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036599:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x2a4cb8b3 (ffff9cf043e52900) 00010000:00010000:3.0:1789066053.036602:0:14413:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789066053.036605:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.036611:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c23 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x2a4cb8b3 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066053.036750:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+26:14494:x1875971236031232:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 3304us (3489us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789066053.036761:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 44 00000100:00100000:2.0:1789066053.041419:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.041498:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236031360 00000100:00100000:0.0:1789066053.041508:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236031360 00000100:00100000:0.0:1789066053.041600:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:0.0:1789066053.041612:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+26:14494:x1875971236031360:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789066053.041632:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066053.041657:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c2a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce182 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.041693:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83c31 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.041708:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83c31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.041719:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83c31 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.041826:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce182 expref: 28 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.041857:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081655600/0x7555615576c83c31 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce182 expref: 27 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.041866:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:0.0:1789066053.041869:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789066053.041880:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081655600, rc 0) 00000100:00100000:0.0:1789066053.041935:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+27:14494:x1875971236031360:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 325us (527us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066053.041943:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 45 00000100:00100000:2.0:1789066053.050177:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.050319:0:14414:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236031616 00000100:00100000:0.0:1789066053.050329:0:14414:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236031616 00000100:00100000:0.0:1789066053.050390:0:14414:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 46 00000100:00100000:0.0:1789066053.050399:0:14414:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+27:14494:x1875971236031616:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789066053.050487:0:14414:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.050505:0:14414:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.050529:0:14414:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789066053.051220:0:14414:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:0.0:1789066053.051232:0:14414:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 512244683334ns, next at 513244681280ns, rc = 0 00000004:00010000:0.0:1789066053.051345:0:14414:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 000000000c656f21 reply state 00000000ae587cb5 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066053.051355:0:14414:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789066053.051461:0:14414:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d8884011-f51c-4c21-8191-38ad45143351+29:14494:x1875971236031616:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 1061us (1291us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1789066053.051470:0:14414:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 46 00010000:00010000:3.0:1789066053.055587:0:3282:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.055609:0:3282:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.055617:0:3282:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.055623:0:3282:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081654600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:3.0:1789066053.055628:0:3282:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.055635:0:3282:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.055670:0:3282:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:3.0:1789066053.055673:0:3282:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789066053.055679:0:3282:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.055685:0:3282:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654600/0x7555615576c83c38 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14414 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066053.063358:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.063658:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236031744 00000100:00100000:0.0:1789066053.063669:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236031744 00000100:00100000:0.0:1789066053.063732:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:0.0:1789066053.063743:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+28:14494:x1875971236031744:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789066053.063782:0:15531:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789066053.063802:0:15531:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce189 expref: -99 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.064053:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 29 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.064071:0:15531:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 29 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.064096:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:0.0:1789066053.064099:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789066053.064103:0:15531:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf081654e00, rc 0) 00000100:00100000:0.0:1789066053.064168:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+29:14494:x1875971236031744:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 427us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066053.064175:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 47 00000100:00100000:1.0:1789066053.083069:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.090208:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236031872 00000100:00100000:0.0:1789066053.090228:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236031872 00000100:00080000:1.0:1789066053.094004:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789066053.094096:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1789066053.094134:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8884011-f51c-4c21-8191-38ad45143351+5:2350:x1875971236031872:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789066053.094808:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07fc95c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8884011-f51c-4c21-8191-38ad45143351+6:2350:x1875971236031872:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 696us (11745us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1789066053.094818:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:2.0:1789066053.106411:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066053.110668:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236032128 00000100:00100000:1.0:1789066053.110686:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236032128 00000100:00100000:1.0:1789066053.110761:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1789066053.110773:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+29:14494:x1875971236032128:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789066053.111098:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+30:14494:x1875971236032128:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 327us (4695us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789066053.111229:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 9 00000100:00100000:1.0:1789066053.115078:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.115372:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236032384 00000100:00100000:3.0:1789066053.115382:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236032384 00000100:00100000:3.0:1789066053.115440:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:3.0:1789066053.115450:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+30:14494:x1875971236032384:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789066053.115783:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+30:14494:x1875971236032384:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 332us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066053.115791:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 48 00000100:00100000:0.0:1789066053.128050:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.128526:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236032512 00000100:00100000:3.0:1789066053.128536:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236032512 00000100:00100000:3.0:1789066053.128638:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:3.0:1789066053.128648:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+30:14494:x1875971236032512:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789066053.128669:0:14411:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066053.128693:0:14411:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c46 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce190 expref: -99 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.128767:0:14411:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c4d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.128782:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.128794:0:14411:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789066053.128848:0:14411:0:(mdt_handler.c:1589:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789066053.128871:0:14411:0:(mdt_handler.c:2560:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c4d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14411 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.128899:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c46 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce190 expref: 32 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.128919:0:14411:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c4d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce190 expref: 31 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.128928:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:3.0:1789066053.128932:0:14411:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789066053.128936:0:14411:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040030e00, rc 0) 00000100:00100000:3.0:1789066053.129065:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+31:14494:x1875971236032512:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 418us (1024us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066053.129073:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 49 00000100:00100000:0.0:1789066053.137600:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.137844:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236032640 00000100:00100000:3.0:1789066053.137856:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236032640 00000100:00100000:3.0:1789066053.137909:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:3.0:1789066053.137920:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf08176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+6:2347:x1875971236032640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789066053.137941:0:15532:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789066053.137963:0:15532:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x64887942ebce197 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789066053.137992:0:15532:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa2fb44, blocks: 0x1 00010000:00010000:3.0:1789066053.138017:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=512s v=(0 0) 00010000:00010000:3.0:1789066053.138037:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066053.138047:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 7 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.138068:0:15532:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 7 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.138083:0:15532:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9cf040031400, rc 0) 00000100:00100000:3.0:1789066053.138317:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf08176bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+7:2347:x1875971236032640:12345-192.168.204.23@tcp:101:lhsmtool_posix.0 Request processed in 397us (727us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066053.138326:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:1.0:1789066053.161439:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066053.161584:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236032896 00000100:00100000:2.0:1789066053.161605:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236032896 00000100:00100000:2.0:1789066053.161670:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:2.0:1789066053.161682:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+31:14494:x1875971236032896:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789066053.161808:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b269c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+31:14494:x1875971236032896:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 128us (383us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066053.161816:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 50 00000100:00100000:2.0:1789066053.165397:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.165478:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236033024 00000100:00100000:3.0:1789066053.165489:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236033024 00000100:00100000:3.0:1789066053.165615:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00100000:3.0:1789066053.165627:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+31:14494:x1875971236033024:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789066053.248795:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1789066053.248810:0:5860:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789066053.248836:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934596 is committed 00000001:00080000:3.0:1789066053.248842:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1789066053.248850:0:5860:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1789066053.249067:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789066053.249090:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258038784:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1789066053.249166:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066053.249241:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258038784 00000100:00100000:0.0:1789066053.249249:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258038784 00000100:00100000:0.0:1789066053.249312:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789066053.249323:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258038784:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:0.0:1789066053.250029:0:15096:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789066053.250035:0:15096:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789066053.250037:0:15096:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789066053.250040:0:15096:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789066052 -> 1789066052 00002000:00010000:0.0:1789066053.250042:0:15096:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1789066053.250096:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3295:x1875971258038784:12345-0@lo:2:osp-syn-0-0.0 Request processed in 774us (930us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789066053.250105:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:3.0:1789066053.250204:0:3295:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9cf07b1bb100/2, rc 0, transno 8589934595 00000100:00100000:3.0:1789066053.250211:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258038784:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1789066053.250417:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d8884011-f51c-4c21-8191-38ad45143351+14:14494:x1875971236033024:12345-192.168.204.23@tcp:44:lhsmtool_posix.0 Request processed in 84790us (85032us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066053.250427:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 51 00000100:00080000:1.0:1789066053.250453:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789066053.253872:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066053.254003:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236033152 00000100:00100000:2.0:1789066053.254015:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236033152 00000100:00100000:2.0:1789066053.254073:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:2.0:1789066053.254096:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+7:2348:x1875971236033152:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789066053.254253:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081691180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+7:2348:x1875971236033152:12345-192.168.204.23@tcp:16:lhsmtool_posix.0 Request processed in 158us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066053.254261:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 16 00000100:00100000:0.0:1789066053.266625:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066053.266776:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236033408 00000100:00100000:2.0:1789066053.266787:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236033408 00000100:00100000:2.0:1789066053.266846:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 52 00000100:00100000:2.0:1789066053.266857:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+14:14494:x1875971236033408:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789066053.266914:0:14413:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789066053.266943:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040030e00/0x7555615576c83c4d lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce190 expref: 14 pid: 14411 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.266964:0:14413:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:2.0:1789066053.266969:0:14413:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789066053.266999:0:14413:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.267013:0:14413:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.267023:0:14413:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789066053.267229:0:14413:0:(mdt_handler.c:4547:mdt_save_lock()) ### save lock request 0000000058693dcc reply state 00000000c5ec5a5b transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066053.267239:0:14413:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789066053.267338:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d8884011-f51c-4c21-8191-38ad45143351+15:14494:x1875971236033408:12345-192.168.204.23@tcp:36:lhsmtool_posix.0 Request processed in 482us (724us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1789066053.267362:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 52 00010000:00010000:2.0:1789066053.269745:0:3281:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.269762:0:3281:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.269780:0:3281:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.269787:0:3281:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1cc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:2.0:1789066053.269791:0:3281:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.269798:0:3281:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.269813:0:3281:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:2.0:1789066053.269816:0:3281:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789066053.269821:0:3281:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.269827:0:3281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1cc00/0x7555615576c83c5b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14413 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066053.271404:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.271831:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236033536 00000100:00100000:3.0:1789066053.271842:0:15096:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236033536 00000100:00100000:3.0:1789066053.271934:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1789066053.271945:0:15096:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8884011-f51c-4c21-8191-38ad45143351+7:2347:x1875971236033536:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789066053.272171:0:15096:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789066053.272175:0:15096:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789066051 00002000:00010000:3.0:1789066053.272177:0:15096:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789066051 00002000:00010000:3.0:1789066053.272179:0:15096:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb ctime from disk: 1789066052 -> 1789066051 00002000:00010000:3.0:1789066053.272181:0:15096:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789066053.272249:0:15096:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d8884011-f51c-4c21-8191-38ad45143351+8:2347:x1875971236033536:12345-192.168.204.23@tcp:2:lhsmtool_posix.0 Request processed in 305us (851us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789066053.272257:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 17 00000100:00100000:3.0:1789066053.277111:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066053.277194:0:15532:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236033664 00000100:00100000:2.0:1789066053.277203:0:15532:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236033664 00000100:00100000:2.0:1789066053.277264:0:15532:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1789066053.277274:0:15532:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+8:2347:x1875971236033664:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789066053.277317:0:15532:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277347:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066053.277351:0:15532:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066053.277357:0:15532:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277372:0:15532:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277404:0:15532:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277412:0:15532:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277420:0:15532:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277426:0:15532:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1d800 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066053.277430:0:15532:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277438:0:15532:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277453:0:15532:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.277479:0:15532:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ddaea2f/0x7555615576c83c62 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15532 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066053.277716:0:15532:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081693b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d8884011-f51c-4c21-8191-38ad45143351+8:2347:x1875971236033664:12345-192.168.204.23@tcp:1:lhsmtool_posix.0 Request processed in 442us (614us total) trans 0 rc 0/0 00000100:00100000:2.0:1789066053.277724:0:15532:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 18 00000100:00100000:2.0:1789066053.286026:0:3298:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789066053.286057:0:3298:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf081691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258038912:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789066053.286139:0:3298:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066053.286251:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258038912 00000100:00100000:0.0:1789066053.286260:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258038912 00000100:00100000:0.0:1789066053.286310:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789066053.286320:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875971258038912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789066053.286357:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789066053.286411:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3298:x1875971258038912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066053.286418:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789066053.286737:0:3298:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf081691880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3298:1875971258038912:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789066053.288126:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066053.288203:0:15531:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236033920 00000100:00100000:2.0:1789066053.288212:0:15531:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236033920 00000100:00100000:2.0:1789066053.288264:0:15531:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 53 00000100:00100000:2.0:1789066053.288274:0:15531:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+14:14494:x1875971236033920:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789066053.288345:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288362:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288373:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288847:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288859:0:15531:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 15 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288874:0:15531:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288906:0:15531:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 15 pid: 15531 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.288920:0:15531:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 15 pid: 15531 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066053.288934:0:15531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1875971258039040:192.168.204.23@tcp:104: 00000100:00100000:2.0:1789066053.289021:0:15531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d776c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789066053.299077:0:15531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1875971258039040:192.168.204.23@tcp:104: 00010000:00010000:2.0:1789066053.299123:0:15531:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066053.302422:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066053.302711:0:16529:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034048 00000100:00100000:1.0:1789066053.302721:0:16529:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034048 00010000:00010000:0.0:1789066053.302819:0:16529:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 16 pid: 15531 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066053.302861:0:16529:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 13 00000100:00100000:0.0:1789066053.302873:0:16529:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d8884011-f51c-4c21-8191-38ad45143351+16:2347:x1875971236034048:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789066053.302889:0:16529:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789066053.302913:0:16529:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 16 pid: 15531 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.302928:0:16529:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 16 pid: 15531 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.302952:0:16529:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf081654e00/0x7555615576c83c3f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce189 expref: 16 pid: 15531 timeout: 612 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.302969:0:16529:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:0.0:1789066053.302974:0:16529:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.302984:0:16529:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.302992:0:16529:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.303027:0:16529:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789066053.303096:0:16529:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:d8884011-f51c-4c21-8191-38ad45143351+15:2347:x1875971236034048:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 226us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066053.303104:0:16529:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 13 00010000:00010000:2.0:1789066053.303728:0:15531:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.303739:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789066053.303930:0:15531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1789066053.304073:0:15531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1789066053.304134:0:15531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1789066053.304221:0:15531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15531:1875971258039168:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789066053.304332:0:15531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066053.304370:0:15531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d77900 going to sleep for 11 seconds 00000100:00100000:0.0:1789066053.304924:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258039168 00000100:00100000:0.0:1789066053.304935:0:14417:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258039168 00000100:00100000:0.0:1789066053.304986:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789066053.304996:0:14417:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15531:x1875971258039168:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789066053.305095:0:14417:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f70c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:15531:x1875971258039168:12345-0@lo:1000:mdt00_003.0 Request processed in 100us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066053.305129:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789066053.306391:0:15531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15531:1875971258039168:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1789066053.308401:0:15531:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1789066053.308501:0:15531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cef433ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15531:1875971258039296:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1789066053.309388:0:15531:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789066053.309503:0:15531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf065d776c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789066053.312610:0:14418:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258039296 00000100:00100000:3.0:1789066053.312627:0:14418:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258039296 00000100:00100000:3.0:1789066053.312683:0:14418:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789066053.312694:0:14418:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:15531:x1875971258039296:12345-0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789066053.312957:0:14418:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:15531:x1875971258039296:12345-0@lo:1000:mdt00_003.0 Request processed in 264us (3570us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1789066053.312965:0:14418:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789066053.313267:0:15531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cef433ba300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:15531:1875971258039296:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1789066053.313312:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313322:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313350:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313356:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fc400 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066053.313361:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313369:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313385:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:1.0:1789066053.313388:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789066053.313393:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313401:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0413fc400/0x7555615576c83c70 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313437:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313444:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313450:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313456:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1dc00 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066053.313459:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313475:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313485:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:1.0:1789066053.313488:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789066053.313495:0:15531:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313507:0:15531:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313517:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.313605:0:15531:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c000/0x7555615576c83bd6 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce16d expref: 18 pid: 14414 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.313620:0:15531:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1875971258039424:192.168.204.23@tcp:105: 00000100:00100000:1.0:1789066053.313700:0:15531:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf060eff900 going to sleep for 11 seconds 00000100:00100000:1.0:1789066053.318953:0:15531:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:15531:1875971258039424:192.168.204.23@tcp:105: 00010000:00010000:1.0:1789066053.318986:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.318998:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1dc00/0x7555615576c83bcf lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319033:0:15531:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319063:0:15531:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319074:0:15531:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319087:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319094:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319100:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319106:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066053.319120:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319128:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319139:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:1.0:1789066053.319142:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789066053.319146:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319152:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf0817a7600/0x7555615576c83c77 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319162:0:15531:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319175:0:15531:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319181:0:15531:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319186:0:15531:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf07fd1c800 already unused, calling callback (ffffffffc1f744f0) 00010000:00010000:1.0:1789066053.319189:0:15531:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319194:0:15531:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319203:0:15531:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9cf043e52c00) 00010000:00010000:1.0:1789066053.319205:0:15531:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789066053.319208:0:15531:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.319213:0:15531:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf07fd1c800/0x7555615576c83c69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15531 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.319455:0:15531:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d8884011-f51c-4c21-8191-38ad45143351+18:14494:x1875971236033920:12345-192.168.204.23@tcp:57:lhsmtool_posix.0 Request processed in 31180us (31333us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1789066053.319466:0:15531:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 53 00000020:00080000:1.0:1789066053.319472:0:15531:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789066053.320216:0:14447:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789066053.320222:0:14447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789066053.320263:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789066053.320268:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789066053.331931:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066053.332046:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034176 00000100:00100000:1.0:1789066053.332058:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034176 00000100:00100000:1.0:1789066053.332123:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:1.0:1789066053.332134:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf0818dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+18:14493:x1875971236034176:12345-192.168.204.23@tcp:49:dd.0 00000100:00100000:1.0:1789066053.332302:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf0818dd050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+18:14493:x1875971236034176:12345-192.168.204.23@tcp:49:dd.0 Request processed in 170us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066053.332311:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 10 00000100:00100000:2.0:1789066053.343059:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.343594:0:14415:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034432 00000100:00100000:3.0:1789066053.343612:0:14415:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034432 00000100:00100000:3.0:1789066053.343698:0:14415:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 11 00000100:00100000:3.0:1789066053.343711:0:14415:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+18:14494:x1875971236034432:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789066053.345374:0:14415:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789066053.346332:0:14415:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1789066053.346739:0:14415:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.346762:0:14415:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.347072:0:14415:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.347084:0:14415:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.347090:0:14415:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.347096:0:14415:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.347349:0:14415:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789066053.347647:0:14415:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d8884011-f51c-4c21-8191-38ad45143351+20:14494:x1875971236034432:12345-192.168.204.23@tcp:35:lhsmtool_posix.0 Request processed in 3826us (4486us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1789066053.347659:0:14415:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 11 00000020:00080000:3.0:1789066053.347668:0:14415:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789066053.358135:0:14401:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789066053.358160:0:14401:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.358176:0:14401:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066053.358182:0:14401:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.358195:0:14401:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.358218:0:14401:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9cf043149800) 00010000:00010000:0.0:1789066053.358221:0:14401:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1789066053.358229:0:14401:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.358236:0:14401:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9cf040031200/0x7555615576c83c7e lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14415 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.358266:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066053.358268:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066053.358271:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789066053.478070:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789066053.633783:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.633830:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066053.633997:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034688 00000100:00100000:1.0:1789066053.634012:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034688 00000100:00100000:1.0:1789066053.634091:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034816 00000100:00100000:1.0:1789066053.634094:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034816 00000100:00100000:1.0:1789066053.634116:0:15101:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1789066053.634127:0:15101:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d8884011-f51c-4c21-8191-38ad45143351+9:2350:x1875971236034688:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:1.0:1789066053.634178:0:15101:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.634206:0:15101:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 9 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.634216:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.634222:0:15101:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.634228:0:15101:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.634282:0:15101:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 9 pid: 15532 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.634300:0:15101:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 9 pid: 15532 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.634350:0:15101:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15101:1875971258039552:192.168.204.23@tcp:104: 00000100:00100000:1.0:1789066053.634498:0:15101:0:(client.c:2716:ptlrpc_set_wait()) set ffff9cf041370840 going to sleep for 11 seconds 00000100:00100000:2.0:1789066053.636926:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.637191:0:15103:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1789066053.637205:0:15103:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789066053.640184:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034560 00000100:00100000:0.0:1789066053.640204:0:15103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034560 00000100:00100000:2.0:1789066053.641103:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:2.0:1789066053.641124:0:16644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d8884011-f51c-4c21-8191-38ad45143351+10:2350:x1875971236034816:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:2.0:1789066053.641186:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.641214:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066053.641221:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066053.641226:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.641239:0:16644:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.641927:0:15101:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b268e00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:15101:1875971258039552:192.168.204.23@tcp:104: 00010000:00010000:1.0:1789066053.641968:0:15101:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066053.643038:0:3290:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066053.644993:0:14399:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236034944 00000100:00100000:1.0:1789066053.645013:0:14399:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236034944 00010000:00010000:1.0:1789066053.645084:0:14399:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 11 pid: 15532 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.645721:0:14399:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 14 00000100:00100000:1.0:1789066053.645738:0:14399:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8884011-f51c-4c21-8191-38ad45143351+11:2348:x1875971236034944:12345-192.168.204.23@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789066053.645760:0:14399:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789066053.645794:0:14399:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 11 pid: 15532 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.645813:0:14399:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 11 pid: 15532 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.646619:0:14399:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f62026b6/0x7555615576c83c54 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.23@tcp remote: 0x64887942ebce197 expref: 11 pid: 15532 timeout: 612 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.646681:0:14399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.646686:0:14399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.646693:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.646705:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.646718:0:14399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.646721:0:14399:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.646725:0:14399:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.646732:0:14399:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.646914:0:16644:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.646925:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.649013:0:14399:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789066053.649097:0:14399:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f55c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:d8884011-f51c-4c21-8191-38ad45143351+11:2348:x1875971236034944:12345-192.168.204.23@tcp:103:ldlm_bl.0 Request processed in 3356us (6060us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066053.649112:0:14399:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 14 00010000:00010000:0.0:1789066053.658256:0:15101:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.658321:0:15101:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789066053.886823:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934595 is committed 00000001:00080000:0.0:1789066053.886859:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:0.0:1789066053.886901:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934597 is committed 00002000:00010000:3.0:1789066053.887034:0:16644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1789066053.887039:0:16644:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb mtime from disk: 1789066051 -> 1789066052 00002000:00010000:3.0:1789066053.887061:0:16644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 1 -> 4103 00010000:00010000:3.0:1789066053.887082:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887098:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887109:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887118:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fd000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066053.887124:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887134:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887163:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887172:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83c8c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066053.887308:0:16644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d8884011-f51c-4c21-8191-38ad45143351+8:2350:x1875971236034816:12345-192.168.204.23@tcp:4:dd.0 Request processed in 246183us (253468us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1789066053.887326:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 1 00000100:00100000:3.0:1789066053.887369:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:3.0:1789066053.887391:0:16644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d8884011-f51c-4c21-8191-38ad45143351+7:2350:x1875971236034560:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:3.0:1789066053.887440:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887455:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1789066053.887460:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066053.887471:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066053.887486:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887863:0:15101:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887874:0:15101:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887896:0:15101:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887902:0:15101:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a7600 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066053.887905:0:15101:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887913:0:15101:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887927:0:15101:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.887935:0:15101:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000986163a3/0x7555615576c83c85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15101 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066053.887982:0:15101:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:d8884011-f51c-4c21-8191-38ad45143351+7:2350:x1875971236034688:12345-192.168.204.23@tcp:4:dd.0 Request processed in 253855us (254212us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789066053.887990:0:15101:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 0 00000100:00100000:1.0:1789066053.900288:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:0.0:1789066053.903253:0:15103:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035072 00000100:00100000:0.0:1789066053.903279:0:15103:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035072 00000100:00100000:0.0:1789066053.903395:0:15103:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 3 00000100:00100000:0.0:1789066053.903411:0:15103:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d8884011-f51c-4c21-8191-38ad45143351+9:2347:x1875971236035072:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:0.0:1789066053.903463:0:15103:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.903487:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066053.903506:0:15103:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789066053.903514:0:15103:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066053.903541:0:15103:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.905073:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.905167:0:15101:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789066053.905179:0:15101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1789066053.911825:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035200 00000100:00100000:1.0:1789066053.911853:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035200 00000100:00100000:1.0:1789066053.913002:0:16646:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 4 00000100:00100000:1.0:1789066053.913023:0:16646:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d8884011-f51c-4c21-8191-38ad45143351+11:2347:x1875971236035200:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:1.0:1789066053.913091:0:16646:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.913121:0:16646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.913127:0:16646:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789066053.913138:0:16646:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066053.913156:0:16646:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066053.928793:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:1.0:1789066053.929478:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066053.937705:0:15101:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:1.0:1789066053.938228:0:3288:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:2.0:1789066053.938303:0:15102:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789066053.942423:0:15101:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:2.0:1789066053.947692:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035456 00000100:00100000:2.0:1789066053.947717:0:15102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035456 00000100:00100000:2.0:1789066053.947824:0:15102:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1789066053.947853:0:15102:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035584 00000100:00100000:2.0:1789066053.947858:0:15102:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035584 00000100:00100000:3.0:1789066053.948433:0:15101:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035328 00000100:00100000:3.0:1789066053.948456:0:15101:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035328 00000100:00100000:2.0:1789066053.949306:0:16647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:2.0:1789066053.949326:0:16647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d8884011-f51c-4c21-8191-38ad45143351+17:2348:x1875971236035456:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:2.0:1789066053.949390:0:16647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.949414:0:16647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066053.949421:0:16647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066053.949431:0:16647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066053.949450:0:16647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789066054.017499:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:2.0:1789066054.030751:0:16644:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 3145728 -> 7340032 00002000:00010000:2.0:1789066054.030764:0:16644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 8199 00010000:00010000:2.0:1789066054.030795:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.030809:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.030820:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.030829:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040031200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:2.0:1789066054.030835:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.030846:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.030886:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.030895:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002ac64e0e/0x7555615576c83c93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789066054.031041:0:16644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07f50ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d8884011-f51c-4c21-8191-38ad45143351+19:2350:x1875971236034560:12345-192.168.204.23@tcp:4:dd.0 Request processed in 143648us (394119us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789066054.031055:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 2 00000100:00100000:2.0:1789066054.031998:0:16644:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 6 00000100:00100000:2.0:1789066054.032020:0:16644:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d8884011-f51c-4c21-8191-38ad45143351+18:2348:x1875971236035584:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:2.0:1789066054.032071:0:16644:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.032090:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066054.032096:0:16644:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789066054.032116:0:16644:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789066054.032133:0:16644:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066054.057806:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066054.058136:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066054.058182:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066054.058213:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066054.058234:0:3289:0:(events.c:344:request_in_callback()) peer: 12345-192.168.204.23@tcp (source: 12345-192.168.204.23@tcp) 00000100:00100000:3.0:1789066054.058280:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035840 00000100:00100000:1.0:1789066054.058280:0:14406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035712 00000100:00100000:3.0:1789066054.058300:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035840 00000100:00100000:1.0:1789066054.058300:0:14406:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035712 00000100:00100000:3.0:1789066054.058387:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236036096 00000100:00100000:1.0:1789066054.058393:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:3.0:1789066054.058395:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236036096 00000100:00100000:1.0:1789066054.058418:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:2347:x1875971236035712:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066054.058427:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236036224 00000100:00100000:3.0:1789066054.058433:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236036224 00000100:00100000:3.0:1789066054.058455:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00100000:3.0:1789066054.058486:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236035840:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:1.0:1789066054.058582:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d88050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0e8af51c-f770-41ac-8f86-9bd33864d1bb+13:2347:x1875971236035712:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 139us (362us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066054.058593:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 122 00000100:00100000:3.0:1789066054.058620:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081693800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236035840:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 133us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066054.058631:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 19 00000100:00080000:1.0:1789066054.058648:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789066054.058657:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789066054.058667:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1789066054.058676:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236036096:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066054.058710:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236036096:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 35us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066054.058717:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 20 00000100:00100000:3.0:1789066054.058743:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:3.0:1789066054.058753:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236036224:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066054.058782:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081692680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+5:2347:x1875971236036224:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 31us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066054.058787:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 21 00000100:00100000:3.0:1789066054.058809:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971236035968 00000100:00100000:3.0:1789066054.058813:0:14413:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971236035968 00000100:00100000:3.0:1789066054.061912:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00100000:3.0:1789066054.061929:0:14413:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2347:x1875971236035968:12345-192.168.204.23@tcp:400:kworker.0 00000100:00100000:3.0:1789066054.066275:0:14413:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081690000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:195e55f3-2761-4c99-af1d-7ca8a37e0a8b+6:2347:x1875971236035968:12345-192.168.204.23@tcp:400:kworker.0 Request processed in 4338us (8047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789066054.066291:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 31 00000100:00080000:1.0:1789066054.067252:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00002000:00010000:3.0:1789066054.167499:0:16647:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:3.0:1789066054.167514:0:16647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1789066054.167570:0:16647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.167610:0:16647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.167622:0:16647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.167630:0:16647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fd200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066054.167636:0:16647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.167646:0:16647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.167673:0:16647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.167681:0:16647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000068b5ca2/0x7555615576c83ca8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066054.167960:0:16647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d8884011-f51c-4c21-8191-38ad45143351+20:2348:x1875971236035456:12345-192.168.204.23@tcp:4:dd.0 Request processed in 218633us (238478us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789066054.167972:0:16647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 5 00000100:00100000:3.0:1789066054.168018:0:16647:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.23@tcp, seq: 7 00000100:00100000:3.0:1789066054.168032:0:16647:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d8884011-f51c-4c21-8191-38ad45143351+19:2347:x1875971236035328:12345-192.168.204.23@tcp:4:dd.0 00010000:00010000:3.0:1789066054.168070:0:16647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168090:0:16647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066054.168095:0:16647:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789066054.168104:0:16647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168129:0:16647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168265:0:16646:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168275:0:16646:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168282:0:16646:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168289:0:16646:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0817a6200 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066054.168292:0:16646:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168300:0:16646:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168312:0:16646:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.168333:0:16646:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013f964cb/0x7555615576c83ca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16646 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066054.168373:0:16646:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:d8884011-f51c-4c21-8191-38ad45143351+18:2347:x1875971236035200:12345-192.168.204.23@tcp:4:dd.0 Request processed in 255359us (263313us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1789066054.168380:0:16646:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 4 00010000:00010000:0.0:1789066054.169630:0:15103:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066054.169650:0:15103:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066054.169670:0:15103:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066054.169677:0:15103:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf081655e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:0.0:1789066054.169681:0:15103:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066054.169689:0:15103:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066054.169709:0:15103:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789066054.169718:0:15103:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3122b59/0x7555615576c83c9a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15103 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789066054.169809:0:15103:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b268e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:d8884011-f51c-4c21-8191-38ad45143351+16:2347:x1875971236035072:12345-192.168.204.23@tcp:4:dd.0 Request processed in 266398us (269532us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1789066054.169818:0:15103:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 3 00000001:00080000:0.0:1789066054.169873:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934601 is committed 00000001:00080000:0.0:1789066054.169891:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934602 is committed 00000001:00080000:0.0:1789066054.169904:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934603 is committed 00000001:00080000:0.0:1789066054.275427:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934604 is committed 00002000:00010000:1.0:1789066054.278393:0:16644:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:1.0:1789066054.278425:0:16644:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066054.278460:0:16644:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066054.278470:0:16644:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066054.278478:0:16644:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf0413fd000 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:1.0:1789066054.278497:0:16644:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066054.278509:0:16644:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066054.278545:0:16644:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789066054.278582:0:16644:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000391db660/0x7555615576c83caf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16644 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789066054.279596:0:16644:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081768380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:d8884011-f51c-4c21-8191-38ad45143351+9:2348:x1875971236035584:12345-192.168.204.23@tcp:4:dd.0 Request processed in 247574us (341364us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789066054.279610:0:16644:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 6 00000001:00080000:2.0:1789066054.362988:0:6711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934605 is committed 00002000:00010000:3.0:1789066054.364537:0:16647:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1789066054.364594:0:16647:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.364607:0:16647:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.364616:0:16647:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.364624:0:16647:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9cf040030e00 already unused, calling callback (ffffffffc154c8b0) 00010000:00010000:3.0:1789066054.364630:0:16647:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.364641:0:16647:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.364665:0:16647:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789066054.364709:0:16647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005a82d058/0x7555615576c83cb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789066054.364830:0:16647:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:d8884011-f51c-4c21-8191-38ad45143351+5:2347:x1875971236035328:12345-192.168.204.23@tcp:4:dd.0 Request processed in 196798us (436045us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1789066054.364841:0:16647:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.23@tcp, seq: 7 00010000:00010000:0.0:1789066054.501715:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789066055.397875:0:14447:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1789066055.397889:0:14447:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789066055.397930:0:14447:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1789066055.397937:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1789066055.526540:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789066055.845919:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258039936:0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.846016:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066055.846077:0:3296:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789066055.846084:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258039808:0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.846106:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066055.846123:0:3296:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258040320:0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.846145:0:3296:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789066055.846173:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258039936 00000100:00100000:0.0:1789066055.846181:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258039936 00000100:00100000:0.0:1789066055.846232:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258039808 00000100:00100000:0.0:1789066055.846236:0:15095:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258039808 00000100:00100000:0.0:1789066055.846261:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789066055.846271:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258039936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.846321:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258039936:12345-0@lo:400:kworker.0 Request processed in 52us (305us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066055.846328:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789066055.846345:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789066055.846351:0:15095:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258039808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.846378:0:15095:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3296:x1875971258039808:12345-0@lo:400:kworker.0 Request processed in 27us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789066055.846383:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789066055.846436:0:3296:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789066055.846441:0:3296:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9cf07b1bb100, transno 8589934595 00000004:00080000:0.0:1789066055.846451:0:3296:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:1.0:1789066055.846586:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258040064:0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.846619:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066055.846648:0:3297:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789066055.846663:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3297:1875971258039680:0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.846691:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066055.846728:0:3297:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf07b1b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258040192:0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.846748:0:3297:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066055.846777:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258040320 00000100:00100000:1.0:1789066055.846781:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258040320 00000100:00100000:1.0:1789066055.846812:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258040064 00000100:00100000:1.0:1789066055.846815:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258040064 00000100:00100000:1.0:1789066055.846827:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258040192 00000100:00100000:1.0:1789066055.846829:0:14411:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258040192 00000100:00100000:1.0:1789066055.846844:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789066055.846849:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971258040320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.846879:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf07b1baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3296:x1875971258040320:12345-0@lo:400:kworker.0 Request processed in 30us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066055.846886:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789066055.846898:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789066055.846904:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cef433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258040064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.846935:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cef433bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3297:x1875971258040064:12345-0@lo:400:kworker.0 Request processed in 32us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066055.846940:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789066055.846951:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789066055.846957:0:14411:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf058003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258040192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.846981:0:14411:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf058003100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3297:x1875971258040192:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066055.846987:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:1.0:1789066055.847002:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789066055.847006:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789066055.847016:0:14408:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789066055.847070:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3297:1875971258040192:0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.847080:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3297:1875971258040064:0@lo:400:kworker.0 00000100:00100000:3.0:1789066055.847225:0:3295:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789066055.847235:0:3295:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff9cf058002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258040448:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789066055.847265:0:3295:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789066055.848233:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258040448 00000100:00100000:1.0:1789066055.848242:0:15099:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258040448 00000100:00100000:1.0:1789066055.848280:0:15099:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789066055.848288:0:15099:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf081691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258040448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789066055.848319:0:15099:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789066055.848374:0:15099:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf081691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3295:x1875971258040448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1107us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066055.848380:0:15099:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789066055.848437:0:3295:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf058002d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3295:1875971258040448:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789066055.849164:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258039808:0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.849187:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3296:1875971258040320:0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.849197:0:3296:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3296:1875971258039936:0@lo:400:kworker.0 00000100:00100000:0.0:1789066055.849668:0:14405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875971258039680 00000100:00100000:0.0:1789066055.849675:0:14405:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1875971258039680 00000100:00100000:1.0:1789066055.849865:0:14406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789066055.849876:0:14406:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff9cf079d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3297:x1875971258039680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789066055.849944:0:14406:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff9cf079d8b450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e+19:3297:x1875971258039680:12345-0@lo:400:kworker.0 Request processed in 70us (3251us total) trans 0 rc 0/0 00000100:00100000:1.0:1789066055.849950:0:14406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1789066055.849997:0:3297:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff9cf07b1b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:82aeb8d7-3216-4823-acbe-8bd0a8ba1a6e:3297:1875971258039680:0@lo:400:kworker.0 00000001:02000400:1.0:1789066056.030812:0:16684:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1789066056.549858:0:14401:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789066057.574516:0:14400:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30051 lines, 30051 kept, 0 dropped, 0 bad.